00000001:02000400:2.0F:1783141611.092213:0:3304:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_hostid 00000001:02000400:2.0:1783141628.676588:0:3528:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1783141630.687753:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 609 MB/s 00000001:01000000:3.0F:1783141630.937764:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 599 MB/s 00000001:01000000:1.0F:1783141631.188460:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4741 MB/s 00000020:02000000:2.0:1783141632.049416:0:3620:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_86_gcbe30f7 00000400:02000000:1.0:1783141633.356382:0:3635:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.139@tcp [8/256/0/180] 00008000:02000000:3.0:1783141637.052888:0:3785:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783141690.583829:0:5750:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783141702.387573:0:6499:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783141702.387578:0:6499:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783141702.387579:0:6499:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783141702.387687:0:6499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000002a033861 00000080:02000400:1.0:1783141702.387698:0:6499:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783141702.395448:0:6499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783141702.395460:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783141702.395487:0:6499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000370a2230) 00000020:00000080:1.0:1783141702.395505:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783141702.467586:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1783141702.467714:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1783141702.493352:0:6499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0F:1783141702.494020:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783141702.494034:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783141702.494045:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a38068b6 00000020:01000004:0.0:1783141702.494052:0:6499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783141702.494056:0:6499:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783141702.494060:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002a033861 from MGS 00000020:01000004:0.0:1783141702.494064:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783141702.494084:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000050b9724) 00000020:00000080:0.0:1783141702.494095:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783141702.495344:0:6499:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a033861 from MGS, refs=2 00080000:01000000:0.0:1783141702.495356:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783141702.495363:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a38068c4 00000100:00100000:0.0:1783141702.495488:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783141702.495599:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783141702.495606:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783141702.497307:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783141702.497318:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783141702.503053:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141702.503234:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783141702.503239:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783141702.505526:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783141702.505665:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783141702.507879:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783141702.507892:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783141702.509238:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141702.509242:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141702.509244:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141702.511258:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141702.511264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141702.511266:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141702.512054:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783141702.515220:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783141702.761435:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2099 MB/s 00000001:01000000:3.0:1783141703.011370:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3779 MB/s 00000001:01000000:1.0:1783141703.261932:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 403 MB/s 00000001:01000000:1.0:1783141703.511667:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 635 MB/s 00080000:10000000:1.0:1783141703.520670:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1783141703.529157:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783141703.530031:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783141703.530079:0:6499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783141703.530115:0:6499:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783141703.530410:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783141703.530445:0:6499:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783141703.530753:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141703.530916:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783141703.530922:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783141703.538186:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783141703.538202:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783141703.538693:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783141703.538699:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783141703.539188:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783141703.539216:0:6499:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.139@tcp' 00000020:01000004:1.0:1783141703.539218:0:6499:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783141703.539326:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.139@tcp (typ=mgc) 00000020:00000080:1.0:1783141703.539337:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.139@tcp (00000000a1a0c10c) 00000020:00000080:1.0:1783141703.539351:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783141703.539445:0:6499:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008cdc76c0@MGC192.168.203.139@tcp: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783141703.539599:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.139@tcp-0 is initialized 00000040:01000000:1.0:1783141703.539605:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 1 is initialized 00000100:00080000:2.0:1783141703.539727:0:6518:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783141703.543537:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783141703.543626:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.139@tcp (uuid 20fff34e-7fb2-485e-92da-c3efe35c6ff5) 00000020:00000080:1.0:1783141703.543650:0:6499:0:(genops.c:1406:class_connect()) connect: client 20fff34e-7fb2-485e-92da-c3efe35c6ff5, cookie 0xb31399d6a38068d2 00000100:00080000:1.0:1783141703.543663:0:6499:0:(import.c:512:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783141703.543669:0:6499:0:(import.c:626:import_select_connection()) MGC192.168.203.139@tcp: import 000000008cdc76c0 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141703.543716:0:6499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab70a166 x1869759520964736/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783141703.543743:0:6499:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS 00000020:01000004:1.0:1783141703.543767:0:6499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783141703.543773:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783141703.543785:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007c695521) 00000020:00000080:1.0:1783141703.543796:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783141703.544481:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab70a166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759520964736:0@lo:250: 00000100:00100000:3.0:1783141703.544566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.544751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520964736 00000100:00100000:2.0:1783141703.544759:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520964736 00000100:00100000:2.0:1783141703.544809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141703.544815:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9d23003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3651:x1869759520964736:12345-0@lo:250: 00010000:00080000:2.0:1783141703.544850:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 20fff34e-7fb2-485e-92da-c3efe35c6ff5@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1783141703.544881:0:6515:0:(genops.c:1406:class_connect()) connect: client 20fff34e-7fb2-485e-92da-c3efe35c6ff5, cookie 0xb31399d6a38068e0 00000100:00080000:2.0:1783141703.545004:0:6515:0:(import.c:65:import_set_state_nolock()) 000000004c862a9a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141703.545075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9d23003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:3651:x1869759520964736:12345-0@lo:250: Request processed in 258us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.545083:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141703.548374:0:3651:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783141703.548390:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 00000100:00080000:3.0:1783141703.548399:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783141703.548404:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783141703.548408:0:3651:0:(import.c:65:import_set_state_nolock()) 000000008cdc76c0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783141703.548412:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783141703.548438:0:3651:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783141703.548446:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab70a166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759520964736:0@lo:250: 00000100:00100000:0.0:1783141703.565732:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141703.565930:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783141703.565937:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:3.0:1783141703.566012:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141703.566672:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783141703.566678:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783141703.567188:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783141703.567195:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783141703.568164:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141703.568374:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783141703.568379:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783141703.571225:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783141703.571245:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783141703.609799:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141703.610338:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783141703.610346:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783141703.613433:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783141703.613449:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783141703.617418:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141703.617662:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141703.617674:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783141703.618742:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141703.618751:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783141703.621610:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141703.621781:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783141703.621787:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783141703.623501:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141703.623511:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783141703.624208:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141703.624553:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783141703.624558:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783141703.625637:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783141703.625646:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783141703.647691:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141703.647883:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141703.647890:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783141703.652900:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783141703.652934:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783141703.658262:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141703.658323:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783141703.659531:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783141703.659558:0:6499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783141703.659564:0:6499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783141703.659661:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783141703.659697:0:6499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783141703.659701:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783141703.659703:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141703.659704:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141703.659705:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141703.659707:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141703.659708:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141703.659709:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141703.659711:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141703.659712:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141703.659713:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141703.659714:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141703.659715:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141703.659717:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783141703.659719:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141703.659720:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141703.659721:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141703.659722:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141703.659723:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141703.659724:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141703.659725:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141703.659726:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141703.659727:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141703.659727:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141703.659728:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141703.659729:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141703.659771:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783141703.659788:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dd8da6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520964864:0@lo:253: 00000100:00100000:2.0:1783141703.659859:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.659907:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000082dac1d7 going to sleep for 11 seconds 00000100:00100000:3.0:1783141703.660417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520964864 00000100:00100000:3.0:1783141703.660436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520964864 00000100:00100000:3.0:1783141703.660493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141703.660500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000731c3057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6499:x1869759520964864:12345-0@lo:253: 20000000:01000000:3.0:1783141703.660545:0:6517:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783141703.660549:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783141703.667476:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783141703.667543:0:6517:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1783141703.667931:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141703.669581:0:6539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783141703.670497:0:6517:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783141703.670502:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783141703.670509:0:6517:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783141703.670512:0:6517:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783141703.670526:0:6517:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783141703.670707:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141703.670865:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783141703.670880:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783141703.670898:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783141703.670912:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783141703.670924:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783141703.671172:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783141703.671183:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783141703.671198:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783141703.671203:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783141703.671215:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783141703.671220:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783141703.671232:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783141703.671247:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783141703.671315:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783141703.671321:0:6517:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783141703.671328:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141703.671411:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783141703.671432:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783141703.671448:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783141703.671462:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783141703.671474:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783141703.671482:0:6517:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783141703.671505:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783141703.671513:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783141703.671526:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783141703.671540:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783141703.671555:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783141703.671562:0:6517:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783141703.671583:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783141703.671590:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783141703.671602:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783141703.671615:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783141703.671675:0:6517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783141703.671697:0:6517:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783141703.671704:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1783141703.672653:0:6540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783141703.672909:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783141703.672934:0:6517:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.139@tcp for mdt 20000000:01000000:1.0:1783141703.672944:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:1.0:1783141703.672963:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783141703.673173:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783141703.673194:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783141703.673201:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:1.0:1783141703.673215:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783141703.673223:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783141703.673235:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783141703.673250:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783141703.673419:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783141703.673431:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783141703.673435:0:6517:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783141703.673476:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783141703.673477:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783141703.674633:0:6541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783141703.674915:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783141703.674941:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783141703.674954:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1783141703.674962:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783141703.674964:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783141703.675626:0:6542:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1783141703.676179:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783141703.676202:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1783141703.676215:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1783141703.676228:0:6517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783141703.676230:0:6517:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1783141703.676235:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783141703.676238:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783141703.676243:0:6517:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783141703.676249:0:6517:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783141703.676637:0:6543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783141703.676823:0:6517:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1783141703.702098:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1783141703.702134:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1783141703.702146:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1783141703.702176:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783141703.702196:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702211:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702220:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702225:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702230:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702235:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702240:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce49c82a already unused, calling callback (00000000f5761fd1) 00010000:00010000:2.0:1783141703.702243:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702249:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702259:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702291:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.702296:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce49c82a/0xb31399d6a38068e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141703.702316:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783141703.715442:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000731c3057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6499:x1869759520964864:12345-0@lo:253: Request processed in 54933us (55574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.715462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141703.715645:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dd8da6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520964864:0@lo:253: 10000000:01000000:2.0:1783141703.715662:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783141703.715665:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783141703.715667:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141703.715668:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141703.715669:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783141703.715670:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141703.715671:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141703.715672:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141703.715674:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141703.715675:0:6499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783141703.715676:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141703.715678:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783141703.715696:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002a033861 from lustre-MDT0000 10000000:01000000:2.0:1783141703.715726:0:6499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783141703.715728:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783141703.715733:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f9c48c28000 10000000:01000000:2.0:1783141703.715738:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783141703.715746:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9c48c28000 from 1 10000000:01000000:2.0:1783141703.715748:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783141703.715785:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.715795:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.715815:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141703.715831:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dd8da6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520964992:0@lo:101: 00000100:00100000:2.0:1783141703.715864:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.715920:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016571a06 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.716035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520964992 00000100:00100000:0.0:1783141703.716042:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520964992 00000100:00100000:0.0:1783141703.716087:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141703.716094:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cf45254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6499:x1869759520964992:12345-0@lo:101: 00010000:00010000:0.0:1783141703.716105:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141703.716117:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38068ee expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.716138:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38068ee expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.716146:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38068ee expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.716155:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006798b6b3, rc 0) 00000100:00100000:0.0:1783141703.716684:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cf45254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6499:x1869759520964992:12345-0@lo:101: Request processed in 588us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.716691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141703.739702:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dd8da6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520964992:0@lo:101: 00010000:00010000:1.0:1783141703.739742:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.739754:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141703.741462:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000499d2a6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965120:0@lo:501: 00000100:00100000:0.0:1783141703.741544:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.741638:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000f4b69d6 going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.742672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965120 00000100:00100000:2.0:1783141703.742681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965120 00000100:00100000:2.0:1783141703.742729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141703.742736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e423dfe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6499:x1869759520965120:12345-0@lo:501: 00000100:00100000:2.0:1783141703.742852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e423dfe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6499:x1869759520965120:12345-0@lo:501: Request processed in 116us (1308us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141703.742860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141703.742967:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000499d2a6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965120:0@lo:501: 10000000:01000000:1.0:1783141703.743005:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783141703.743031:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743041:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141703.743050:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c4bd6c000 10000000:01000000:1.0:1783141703.743056:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783141703.743061:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f9c4bd6c000 10000000:01000000:1.0:1783141703.743063:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783141703.743066:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f9c4bd6c000 from 1 10000000:01000000:1.0:1783141703.743069:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783141703.743095:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743103:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743111:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.743125:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965248:0@lo:101: 00000100:00100000:1.0:1783141703.743173:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.743208:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000002eca0999 going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.743259:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965248 00000100:00100000:2.0:1783141703.743263:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965248 00000100:00100000:2.0:1783141703.743307:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141703.743313:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040133108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6499:x1869759520965248:12345-0@lo:101: 00010000:00010000:2.0:1783141703.743321:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141703.743331:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce49c82a/0xb31399d6a3806903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38068fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.743348:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce49c82a/0xb31399d6a3806903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38068fc expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.743357:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce49c82a/0xb31399d6a3806903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38068fc expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.743365:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce49c82a, rc 0) 00000100:00100000:2.0:1783141703.743394:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040133108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:6499:x1869759520965248:12345-0@lo:101: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.743400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141703.743766:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965248:0@lo:101: 00010000:00010000:1.0:1783141703.743778:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743785:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141703.743798:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783141703.743801:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743807:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 0000000033d2bb23/0xb31399d6a38068fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141703.743812:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783141703.743815:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141703.743820:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f9c4bd6c000 10000000:01000000:1.0:1783141703.743822:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783141703.743825:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783141703.743827:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783141703.743839:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743844:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.743850:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.743866:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965376:0@lo:101: 00000100:00100000:1.0:1783141703.743891:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.743918:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000002eca0999 going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.744297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965376 00000100:00100000:2.0:1783141703.744302:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965376 00000100:00100000:2.0:1783141703.744329:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141703.744335:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4500254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:6499:x1869759520965376:12345-0@lo:101: 00010000:00010000:2.0:1783141703.744344:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141703.744352:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380690a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.744365:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380690a expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.744372:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380690a expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.744380:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067f2a481, rc 0) 00000100:00100000:1.0:1783141703.744520:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965376:0@lo:101: 00010000:00010000:1.0:1783141703.744530:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.744537:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.744582:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965504:0@lo:501: 00000100:00100000:1.0:1783141703.745934:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.745981:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000002eca0999 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.746065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965504 00000100:00100000:0.0:1783141703.746073:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965504 00000100:00100000:0.0:1783141703.746120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141703.746128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086be5e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:6499:x1869759520965504:12345-0@lo:501: 00000100:00100000:0.0:1783141703.746262:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086be5e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520965504:12345-0@lo:501: Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.746302:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141703.746476:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a538a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965504:0@lo:501: 00000100:00100000:3.0:1783141703.746541:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965632:0@lo:503: 00000100:00100000:3.0:1783141703.746580:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141703.746600:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ec986f89 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.746848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965632 00000100:00100000:0.0:1783141703.746853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965632 00000100:00100000:0.0:1783141703.746873:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141703.746885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c88b85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520965632:12345-0@lo:503: 00000100:00100000:0.0:1783141703.746972:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c88b85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520965632:12345-0@lo:503: Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.746979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141703.747055:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520965632:0@lo:503: 00000100:00100000:3.0:1783141703.747637:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6544:1869759520965760:0@lo:502: 00000100:00100000:3.0:1783141703.747679:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141703.747710:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d012cb95 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.747747:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965760 00000100:00100000:0.0:1783141703.747752:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965760 00000100:00100000:0.0:1783141703.747781:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783141703.747787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000783a98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6544:x1869759520965760:12345-0@lo:502: 00000100:00100000:0.0:1783141703.747867:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000783a98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6544:x1869759520965760:12345-0@lo:502: Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.747874:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783141703.747957:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6544:1869759520965760:0@lo:502: 00000020:01000000:3.0:1783141703.747977:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141703.747986:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141703.747988:0:6544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783141703.747996:0:6544:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783141703.748000:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783141703.748019:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000c82e816) 00000020:00000080:3.0:1783141703.748033:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783141703.748039:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783141703.748111:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783141703.748117:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a380691f 00000020:00000080:3.0:1783141703.752971:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783141703.752983:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141703.752990:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141703.752993:0:6544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783141703.752996:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141703.753001:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141703.753002:0:6544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783141703.753006:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783141703.753019:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003c4339bc) 00000020:00000080:3.0:1783141703.753040:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783141703.753044:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783141703.753046:0:6544:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783141703.753048:0:6544:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783141703.753054:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783141703.753144:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a033861 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783141703.753157:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006cdf7ef0) 00000020:00000080:3.0:1783141703.753181:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783141703.753235:0:6544:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783141703.753242:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806934 00000020:00000080:3.0:1783141703.753440:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783141703.753447:0:6544:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783141703.753452:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb31399d6a380693b 00080000:01000000:3.0:1783141703.753459:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783141703.753464:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3806942 00000100:00100000:2.0:1783141703.753739:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4500254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:6499:x1869759520965376:12345-0@lo:101: Request processed in 9399us (9842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.753751:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:3.0:1783141703.753933:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1783141703.754068:0:6544:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783141703.758260:0:6544:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783141703.879884:0:6544:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783141703.880181:0:6544:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783141703.895694:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783141703.896100:0:6544:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783141703.908255:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e6ef1baa) 00000020:00000080:0.0:1783141703.908304:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783141703.909806:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783141703.909817:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3806950 00000020:00000080:0.0:1783141703.912255:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783141703.913197:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1783141703.917709:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1783141703.932850:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1783141703.940038:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1783141703.946795:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1783141703.949750:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1783141703.951941:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb31399d6a3806957 00000020:00000080:1.0:1783141703.953416:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783141703.953438:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141703.953444:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141703.953447:0:6544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783141703.953450:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141703.953619:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141703.953622:0:6544:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783141703.953626:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783141703.953636:0:6544:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783141703.953639:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141703.953641:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141703.953643:0:6544:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783141703.953645:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141703.953649:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141703.953650:0:6544:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783141703.953654:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783141703.953700:0:6544:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1783141703.953756:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009aa9c6dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6544:1869759520965888:0@lo:502: 00000100:00100000:1.0:1783141703.953832:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.953893:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520965888 00000100:00100000:0.0:1783141703.953901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520965888 00000100:00100000:1.0:1783141703.953952:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 0000000081715c6c going to sleep for 11 seconds 00000100:00100000:1.0:1783141703.958932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141703.958946:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000903a32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:6544:x1869759520965888:12345-0@lo:502: 00000100:00100000:1.0:1783141703.959128:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000903a32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:6544:x1869759520965888:12345-0@lo:502: Request processed in 186us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141703.959136:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141703.959854:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009aa9c6dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6544:1869759520965888:0@lo:502: 00000020:01000000:2.0:1783141703.959893:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141703.959900:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141703.959909:0:6544:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1783141703.959914:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783141703.960552:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783141703.960843:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783141703.960918:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.960929:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141703.960938:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c4bd6c000 from 1 10000000:01000000:1.0:1783141703.960941:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783141703.960977:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.960995:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.961005:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.961023:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966016:0@lo:101: 00000100:00100000:1.0:1783141703.961079:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.961136:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000009be5693b going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.961240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966016 00000100:00100000:2.0:1783141703.961247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966016 00000100:00100000:2.0:1783141703.961307:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141703.961315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7c63a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:6499:x1869759520966016:12345-0@lo:101: 00010000:00010000:2.0:1783141703.961327:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141703.961338:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380695e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.961358:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380695e expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.961367:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380695e expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.961375:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca11120c, rc 0) 00000100:00100000:2.0:1783141703.961486:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7c63a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520966016:12345-0@lo:101: Request processed in 171us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.961492:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141703.964254:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966016:0@lo:101: 00010000:00010000:1.0:1783141703.964324:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.964335:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.964918:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966144:0@lo:256: 00000100:00100000:1.0:1783141703.964988:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.965040:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000009be5693b going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.965170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966144 00000100:00100000:2.0:1783141703.965176:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966144 00000100:00100000:2.0:1783141703.965214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141703.965220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003656abdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520966144:12345-0@lo:256: 20000000:01000000:2.0:1783141703.965239:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783141703.965245:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783141703.965341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003656abdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520966144:12345-0@lo:256: Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.965348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141703.965790:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966144:0@lo:256: 10000000:01000000:1.0:1783141703.966401:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141703.966432:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.966443:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141703.966465:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c4bd6c000 from 1 10000000:01000000:1.0:1783141703.966468:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141703.966498:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.966505:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141703.966514:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141703.966529:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966272:0@lo:101: 00000100:00100000:1.0:1783141703.966586:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.966618:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000009be5693b going to sleep for 11 seconds 00000100:00100000:2.0:1783141703.966908:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966272 00000100:00100000:2.0:1783141703.966915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966272 00000100:00100000:2.0:1783141703.966959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141703.966966:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aca8ee38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:6499:x1869759520966272:12345-0@lo:101: 00010000:00010000:2.0:1783141703.966979:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141703.966992:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380696c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141703.967096:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380696c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141703.967109:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380696c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141703.967117:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041349d41, rc 0) 00000100:00100000:3.0:1783141703.967169:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aca8ee38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966272:12345-0@lo:101: Request processed in 204us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141703.967176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141703.967209:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005450ba9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966272:0@lo:101: 00010000:00010000:2.0:1783141703.967224:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.967232:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141703.967332:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966400:0@lo:501: 00000100:00100000:2.0:1783141703.967360:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.967380:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000069a6d2e8 going to sleep for 11 seconds 00000100:00100000:1.0:1783141703.967552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966400 00000100:00100000:1.0:1783141703.967952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966400 00000100:00100000:1.0:1783141703.967993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141703.967999:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c33080b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966400:12345-0@lo:501: 00000100:00100000:1.0:1783141703.968192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c33080b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966400:12345-0@lo:501: Request processed in 193us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141703.968199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141703.968446:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966400:0@lo:501: 00000100:00100000:2.0:1783141703.968480:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966528:0@lo:503: 00000100:00100000:2.0:1783141703.968527:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.968553:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000069a6d2e8 going to sleep for 11 seconds 00000100:00100000:1.0:1783141703.968900:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966528 00000100:00100000:1.0:1783141703.968905:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966528 00000100:00100000:1.0:1783141703.968999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783141703.969007:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b57003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966528:12345-0@lo:503: 00000040:00080000:1.0:1783141703.969044:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141703.969093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b57003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966528:12345-0@lo:503: Request processed in 88us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141703.969106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783141703.969168:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966528:0@lo:503: 00000040:00080000:2.0:1783141703.972049:0:6548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1783141703.972301:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1783141703.972321:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141703.972338:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972349:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141703.972407:0:6499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783141703.972410:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c4bd6c000 10000000:01000000:0.0:1783141703.972436:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c4bd6c000 10000000:01000000:0.0:1783141703.972441:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141703.972446:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c4bd6c000 from 1 10000000:01000000:0.0:1783141703.972449:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141703.972480:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972488:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972498:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141703.972517:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf0b4591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966656:0@lo:101: 00000100:00100000:0.0:1783141703.972588:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.972631:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000006aabf615 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.972652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966656 00000100:00100000:0.0:1783141703.972658:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966656 00000100:00100000:0.0:1783141703.972687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141703.972694:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af7066a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520966656:12345-0@lo:101: 00010000:00010000:0.0:1783141703.972707:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141703.972716:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380697a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972738:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972747:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141703.972755:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a8555d0, rc 0) 00000100:00100000:0.0:1783141703.973098:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af7066a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520966656:12345-0@lo:101: Request processed in 403us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.973106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141703.973300:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf0b4591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966656:0@lo:101: 00010000:00010000:2.0:1783141703.973318:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141703.973334:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141703.973532:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966784:0@lo:501: 00000100:00100000:2.0:1783141703.977063:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.977130:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b6d2d0ef going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.977226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966784 00000100:00100000:0.0:1783141703.977235:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966784 00000100:00100000:0.0:1783141703.977303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141703.977311:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000586ea936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520966784:12345-0@lo:501: 00000100:00100000:0.0:1783141703.977475:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000586ea936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520966784:12345-0@lo:501: Request processed in 166us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.977482:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783141703.977945:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966784:0@lo:501: 00000100:00100000:2.0:1783141703.977988:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966912:0@lo:503: 00000100:00100000:2.0:1783141703.978037:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.978058:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b6d2d0ef going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.979225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520966912 00000100:00100000:0.0:1783141703.979236:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520966912 00000100:00100000:0.0:1783141703.979312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141703.979321:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f47cff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520966912:12345-0@lo:503: 00000100:00100000:0.0:1783141703.979477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f47cff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520966912:12345-0@lo:503: Request processed in 157us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.979484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783141703.979712:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520966912:0@lo:503: 00000100:00100000:1.0:1783141703.981330:0:6549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e48603b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6549:1869759520967040:0@lo:502: 00000100:00100000:1.0:1783141703.981915:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.981992:0:6549:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035593919 going to sleep for 11 seconds 00000100:00100000:0.0:1783141703.983045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967040 00000100:00100000:0.0:1783141703.983057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967040 00000100:00100000:1.0:1783141703.983268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141703.983294:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c763e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6549:x1869759520967040:12345-0@lo:502: 00000100:00100000:1.0:1783141703.983462:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c763e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6549:x1869759520967040:12345-0@lo:502: Request processed in 170us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141703.983470:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141703.983574:0:6549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e48603b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6549:1869759520967040:0@lo:502: 00000020:01000004:0.0:1783141703.983644:0:6549:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783141703.983659:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004d390d69) 00000020:00000080:0.0:1783141703.983674:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783141703.983874:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002a033861 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783141703.983878:0:6549:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002a033861 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783141703.983880:0:6549:0:(obd_mount.c:701:lustre_put_lsi()) put 000000002a033861 4 00010000:00080000:0.0:1783141703.983904:0:6549:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c61530e4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141703.986147:0:6549:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1783141703.986252:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783141703.986311:0:6549:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783141703.986323:0:6549:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb31399d6a380698f 00000100:00080000:0.0:1783141703.986332:0:6549:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141703.986337:0:6549:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c61530e4 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141703.986369:0:6549:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001fa2b3f5 x1869759520967168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141703.986414:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fa2b3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759520967168:0@lo:38: 00000100:00080000:1.0:1783141703.992877:0:6549:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783141703.996517:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141703.996831:0:6549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ca144b42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6549:1869759520967296:0@lo:502: 00000100:00100000:1.0:1783141703.996884:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.997062:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967168 00000100:00100000:0.0:1783141703.997070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967168 00000100:00100000:2.0:1783141703.997133:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141703.997140:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb603f02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759520967168:12345-0@lo:38: 00000100:00100000:2.0:1783141703.997185:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb603f02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759520967168:12345-0@lo:38: Request processed in 44us (677us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783141703.997192:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141703.997372:0:6549:0:(client.c:2701:ptlrpc_set_wait()) set 00000000015b177e going to sleep for 11 seconds 00000100:00100000:3.0:1783141703.998346:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967296 00000100:00100000:3.0:1783141703.998355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967296 00000100:00100000:3.0:1783141703.998479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783141703.998486:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035e829ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6549:x1869759520967296:12345-0@lo:502: 00000100:00100000:0.0:1783141703.998714:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141703.998721:0:3651:0:(import.c:65:import_set_state_nolock()) 00000000c61530e4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141703.998725:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783141703.998729:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fa2b3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759520967168:0@lo:38: 00000100:00100000:3.0:1783141703.999151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035e829ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6549:x1869759520967296:12345-0@lo:502: Request processed in 665us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141703.999158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783141704.001485:0:6549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ca144b42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6549:1869759520967296:0@lo:502: 00000040:00080000:0.0:1783141704.001525:0:6549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783141704.002090:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783141704.002111:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783141704.002133:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141704.002144:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783141704.002197:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783141704.002202:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141704.002204:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141704.002205:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141704.002206:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141704.002207:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141704.002208:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141704.002209:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141704.002210:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141704.002211:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141704.002213:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141704.002214:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141704.002219:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783141704.002221:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141704.002222:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141704.002223:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141704.002224:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141704.002224:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141704.002225:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141704.002226:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141704.002227:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141704.002228:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141704.002228:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141704.002229:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141704.002230:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141704.002250:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783141704.002300:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520967424:0@lo:253: 00000100:00100000:2.0:1783141704.002368:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141704.002416:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000069a6d2e8 going to sleep for 11 seconds 00000100:00100000:1.0:1783141704.002494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967424 00000100:00100000:1.0:1783141704.002501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967424 00000100:00100000:1.0:1783141704.002548:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783141704.002569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039708bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6499:x1869759520967424:12345-0@lo:253: 20000000:01000000:1.0:1783141704.002594:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783141704.002608:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783141704.017922:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783141704.017941:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783141704.018548:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783141704.018554:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783141704.018575:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.018599:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380695e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.018623:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.018663:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.018677:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 12 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141704.018691:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d9b476bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520967552:0@lo:104: 00000100:00100000:1.0:1783141704.018758:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141704.018815:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035593919 going to sleep for 11 seconds 00000100:00100000:3.0:1783141704.018903:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967552 00000100:00100000:3.0:1783141704.018910:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967552 00000100:00100000:3.0:1783141704.018964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141704.018972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1990f05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520967552:12345-0@lo:104: 00010000:00010000:3.0:1783141704.018983:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141704.019047:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783141704.019052:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1990f05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520967552:12345-0@lo:104: Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141704.019060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141704.019145:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d9b476bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520967552:0@lo:104: 00010000:00010000:2.0:1783141704.019173:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019306:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141704.019311:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019318:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a21961df already unused, calling callback (000000008078156d) 10000000:00010000:0.0:1783141704.019321:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019328:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141704.019341:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141704.019346:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141704.019435:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019441:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141704.019666:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019673:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000a21961df/0xb31399d6a380695e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806965 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141704.019691:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141704.019692:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141704.019694:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141704.020739:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141704.020755:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fa2b3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520967680:0@lo:103: 00000100:00100000:0.0:1783141704.020811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141704.021120:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967680 00000100:00100000:1.0:1783141704.021128:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967680 00010000:00010000:1.0:1783141704.021165:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 13 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141704.021200:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141704.021208:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4dadd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3652:x1869759520967680:12345-0@lo:103: 00010000:00010000:1.0:1783141704.021220:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141704.021225:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 13 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021235:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 13 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021249:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca11120c/0xb31399d6a3806965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380695e expref: 13 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021313:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021321:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783141704.021336:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002783564s 00010000:00010000:1.0:1783141704.021340:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021346:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021352:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021358:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021364:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008af70807 already unused, calling callback (00000000f5761fd1) 00010000:00010000:1.0:1783141704.021376:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021383:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021399:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141704.021409:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141704.021668:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141704.021676:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141704.021680:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008af70807/0xb31399d6a3806996 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141704.021730:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4dadd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:3652:x1869759520967680:12345-0@lo:103: Request processed in 523us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141704.021738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141704.021818:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fa2b3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520967680:0@lo:103: 00000100:00100000:0.0:1783141704.022202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039708bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6499:x1869759520967424:12345-0@lo:253: Request processed in 19645us (19833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141704.022211:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141704.022406:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007fe35032 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6499:1869759520967424:0@lo:253: 10000000:01000000:3.0:1783141704.022428:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783141704.022431:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141704.022433:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141704.022434:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141704.022436:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141704.022437:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141704.022438:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141704.022439:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141704.022440:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141704.022442:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141704.022443:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141704.022444:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141704.022446:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783141704.022460:0:6499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783141704.032585:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.032778:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783141704.033007:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.033166:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783141704.033774:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.034009:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783141704.035239:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.035822:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783141704.036079:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.036700:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783141704.036986:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1783141704.037242:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1783141704.041714:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783141704.057053:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783141704.057610:0:6554:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1783141704.057615:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783141704.057690:0:6555:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783141704.060114:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783141704.060224:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783141704.060759:0:6499:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783141704.060768:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783141704.060883:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141704.066223:0:6499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783141704.067147:0:6499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783141704.067186:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783141704.067204:0:6555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141704.068264:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783141704.071029:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1783141704.073217:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1783141704.074945:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1783141704.075125:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1783141704.075259:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1783141704.075535:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1783141704.075660:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1783141704.075937:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1783141704.076060:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1783141704.076166:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1783141704.076289:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1783141704.076530:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1783141704.076636:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1783141704.076858:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1783141704.076981:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1783141704.077097:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1783141704.077214:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1783141704.077617:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:0.0:1783141704.077690:0:6555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1783141704.077747:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000004:00080000:0.0:1783141704.077754:0:6555:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783141704.077758:0:6555:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1783141704.077995:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1783141704.078129:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1783141704.078256:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1783141704.078546:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1783141704.078645:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1783141704.078734:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1783141704.078934:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1783141704.079066:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1783141704.079146:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1783141704.079344:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1783141704.079621:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1783141704.079825:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1783141704.079935:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1783141704.080036:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1783141704.080248:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1783141704.083492:0:6499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783141704.083530:0:6499:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb174197b988 00100000:10000000:1.0:1783141704.083539:0:6499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783141704.085616:0:6499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783141704.085633:0:6499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783141704.085652:0:6499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783141704.085669:0:6499:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783141704.086358:0:6499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783141704.086555:0:6499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1783141704.581026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141705.604879:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141706.630462:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141707.655211:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141708.677208:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141708.694219:0:6800:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1783141709.060563:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783141709.060577:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783141709.060581:0:38:0:(import.c:65:import_set_state_nolock()) 00000000c61530e4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141709.060599:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c61530e4 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141709.060628:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047d82de7 x1869759520967936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141709.061934:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fa816778 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520967808:0@lo:400: 00000100:00100000:0.0:1783141709.062045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141709.062130:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000047d82de7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759520967936:0@lo:38: 00000100:00100000:0.0:1783141709.062166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141709.062177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967808 00000100:00100000:2.0:1783141709.062187:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967808 00000100:00100000:2.0:1783141709.062245:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141709.062253:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088e35dcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:3654:x1869759520967808:12345-0@lo:400: 00000100:00100000:2.0:1783141709.062347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088e35dcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:3654:x1869759520967808:12345-0@lo:400: Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141709.062390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141709.062518:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520967936 00000100:00100000:3.0:1783141709.062523:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520967936 00000100:00100000:3.0:1783141709.062550:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141709.062555:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fa2b3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1869759520967936:12345-0@lo:38: 00010000:00080000:3.0:1783141709.062695:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000100:00100000:0.0:1783141709.062954:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fa816778 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520967808:0@lo:400: 00000020:00000080:3.0:1783141709.064031:0:6524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb31399d6a380699d 00000004:00100000:3.0:1783141709.064107:0:6524:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783141709.064227:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000f01bcc47 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141709.064332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fa2b3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759520967936:12345-0@lo:38: Request processed in 1775us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141709.064343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783141709.065010:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047d82de7 x1869759520967936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783141709.065032:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783141709.065042:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783141709.065048:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783141709.065050:0:3651:0:(import.c:65:import_set_state_nolock()) 00000000c61530e4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783141709.065058:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000047d82de7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759520967936:0@lo:38: 00010000:00010000:0.0:1783141709.700978:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783141709.821024:0:6852:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141709.821629:0:6852:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141710.724459:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141711.748717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783141712.134056:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783141712.134062:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c4bd6c000 from 3 10000000:01000000:0.0:1783141712.134066:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141712.134104:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134126:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134137:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141712.134160:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520968064:0@lo:101: 00000100:00100000:0.0:1783141712.134229:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141712.134304:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a8116e3 going to sleep for 11 seconds 00000100:00100000:0.0:1783141712.134327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968064 00000100:00100000:0.0:1783141712.134333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968064 00000100:00100000:0.0:1783141712.134388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141712.134396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000615376d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6519:x1869759520968064:12345-0@lo:101: 00010000:00010000:0.0:1783141712.134408:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141712.134419:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38069a4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134438:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134447:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134455:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000118c464, rc 0) 00000100:00100000:0.0:1783141712.134502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000615376d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520968064:12345-0@lo:101: Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141712.134509:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141712.134555:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520968064:0@lo:101: 00010000:00010000:0.0:1783141712.134574:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134581:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141712.134622:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520968192:0@lo:256: 00000100:00100000:0.0:1783141712.134650:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141712.134664:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a8116e3 going to sleep for 11 seconds 00000100:00100000:0.0:1783141712.134676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968192 00000100:00100000:0.0:1783141712.134679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968192 00000100:00100000:0.0:1783141712.134701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783141712.134706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4bdc94f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520968192:12345-0@lo:256: 20000000:01000000:0.0:1783141712.134718:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783141712.134733:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783141712.134736:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783141712.134806:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4bdc94f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520968192:12345-0@lo:256: Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141712.134813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783141712.134841:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520968192:0@lo:256: 10000000:01000000:0.0:1783141712.134880:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783141712.134886:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141712.134892:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1783141712.572902:0:6954:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141712.573117:0:6954:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141712.784689:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141713.800589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141714.182912:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141714.182936:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ee2b7d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520968320:0@lo:400: 00000100:00100000:2.0:1783141714.183011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.183073:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520968448:0@lo:400: 00000100:00100000:2.0:1783141714.183106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.183142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968320 00000100:00100000:2.0:1783141714.183148:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968320 00000100:00100000:2.0:1783141714.183194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141714.183201:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003925fdf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:3654:x1869759520968320:12345-0@lo:400: 00000100:00100000:2.0:1783141714.183247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003925fdf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:3654:x1869759520968320:12345-0@lo:400: Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.183254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141714.183299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968448 00000100:00100000:2.0:1783141714.183302:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968448 00000100:00100000:2.0:1783141714.183327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141714.183332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000160d5474 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520968448:12345-0@lo:400: 00000100:00100000:2.0:1783141714.183376:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000160d5474 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520968448:12345-0@lo:400: Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.183382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783141714.183422:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ae35fa69 x1869759520968448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141714.183435:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520968448:0@lo:400: 00000100:00100000:2.0:1783141714.183477:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ee2b7d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520968320:0@lo:400: 00010000:00010000:2.0:1783141714.820704:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141715.844624:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141716.870486:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141717.904706:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141718.916528:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141719.300505:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141719.300532:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520968704:0@lo:400: 00000100:00100000:3.0:1783141719.300617:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141719.300698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968704 00000100:00100000:3.0:1783141719.300706:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968704 00000100:00100000:3.0:1783141719.300748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141719.300766:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009136d6e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520968704:12345-0@lo:400: 00000100:00100000:3.0:1783141719.300823:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009136d6e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520968704:12345-0@lo:400: Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141719.300831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783141719.300868:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bfeacf9e x1869759520968704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141719.300883:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520968704:0@lo:400: 00000100:00100000:2.0:1783141719.301075:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520968576:0@lo:400: 00000100:00100000:2.0:1783141719.301113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141719.301211:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968576 00000100:00100000:3.0:1783141719.301216:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968576 00000100:00100000:3.0:1783141719.301852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141719.301863:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000623d344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:3653:x1869759520968576:12345-0@lo:400: 00000100:00100000:3.0:1783141719.301923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000623d344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:3653:x1869759520968576:12345-0@lo:400: Request processed in 63us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141719.301940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141719.302007:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd240ffe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520968576:0@lo:400: 00010000:00010000:3.0:1783141719.940462:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141720.968692:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783141721.824816:0:7452:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783141721.824821:0:7452:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783141721.824822:0:7452:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783141721.824965:0:7452:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004ef28afb 00000020:01000004:2.0:1783141721.824981:0:7452:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1783141721.824992:0:7452:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783141721.825013:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b8a36156) 00000020:00000080:2.0:1783141721.825030:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783141721.899072:0:7452:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1783141721.899156:0:7452:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1783141721.946987:0:7452:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783141721.947195:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783141721.947205:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783141721.947214:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a38069b9 00000020:01000004:2.0:1783141721.947219:0:7452:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783141721.947246:0:7452:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783141721.947249:0:7452:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783141721.947254:0:7452:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783141721.947317:0:7452:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783141721.947321:0:7452:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783141721.978233:0:7452:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783141721.978617:0:7452:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1783141721.978622:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783141721.978624:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783141721.978625:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141721.978626:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141721.978627:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141721.978628:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141721.978630:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141721.978636:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141721.978637:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141721.978638:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141721.978640:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141721.978643:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1783141721.978645:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141721.978646:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783141721.978647:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141721.978648:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141721.978649:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141721.978650:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141721.978651:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141721.978652:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141721.978652:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141721.978653:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141721.978654:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141721.978696:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783141721.978715:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ee2b7d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520968832:0@lo:253: 00000100:00100000:2.0:1783141721.978909:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141721.979004:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000736ec2df going to sleep for 11 seconds 00000100:00100000:0.0:1783141721.979051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968832 00000100:00100000:0.0:1783141721.979059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968832 00000100:00100000:0.0:1783141721.979634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141721.979644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000732dbbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520968832:12345-0@lo:253: 20000000:01000000:0.0:1783141721.979676:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783141721.979680:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1783141721.979686:0:6515:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1783141721.979689:0:6515:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1783141721.979728:0:6515:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1783141721.979971:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141721.980114:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783141721.980128:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783141721.980147:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783141721.980163:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783141721.980178:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783141721.980230:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1783141721.980238:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1783141721.980251:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1783141721.980257:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1783141721.980268:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1783141721.980311:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1783141721.980326:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783141721.980341:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783141721.980634:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1783141721.980646:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:0.0:1783141721.980660:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1783141721.980667:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783141721.980679:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1783141721.980684:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:0.0:1783141721.980708:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1783141721.980714:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783141721.980725:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783141721.980740:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783141721.980751:0:6515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783141721.980830:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1783141721.980839:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1783141721.980852:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783141721.980869:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783141721.980888:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1783141721.980894:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1783141721.980906:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783141721.980924:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783141721.980928:0:6515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1783141721.980949:0:6515:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783141721.980956:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1783141721.982124:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783141721.982714:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783141721.982740:0:6515:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.139@tcp for mdt 20000000:01000000:0.0:1783141721.982742:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:0.0:1783141721.982757:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783141721.982762:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783141721.982773:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783141721.982778:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:0.0:1783141721.982792:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783141721.982800:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1783141721.982814:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1783141721.982829:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1783141721.982873:0:6515:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1783141721.982882:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1783141721.987479:0:7459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783141721.987805:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783141721.987839:0:6515:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.203.139@tcp for mdt 20000000:01000000:0.0:1783141721.987842:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:0.0:1783141721.987859:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783141721.987865:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783141721.987878:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783141721.987883:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:0.0:1783141721.987896:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783141721.987903:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783141721.987916:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783141721.987930:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783141721.987953:0:6515:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783141721.987955:0:6515:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783141721.987959:0:6515:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783141721.988001:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783141721.988003:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141721.988253:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141721.988305:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141721.988337:0:7460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1783141721.988617:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1783141721.988637:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1783141721.988652:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1783141721.988662:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783141721.988664:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 00010000:00010000:2.0:1783141721.988998:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1783141721.989221:0:7461:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783141721.989242:0:7461:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783141721.989254:0:7461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1783141721.989401:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1783141721.989435:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1783141721.989572:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1783141721.989585:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783141721.989587:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783141721.990021:0:7462:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1783141721.990044:0:7462:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1783141721.990056:0:7462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783141721.990186:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783141721.990205:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783141721.990228:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783141721.990242:0:6515:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783141721.990244:0:6515:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783141721.990248:0:6515:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783141721.990254:0:6515:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783141721.990745:0:7463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1783141721.990841:0:6515:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783141722.016437:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783141722.016837:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016858:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38068ee expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016865:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380690a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016871:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016878:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016921:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.016934:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.016947:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520968960:0@lo:104: 00000100:00100000:3.0:1783141722.017035:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141722.017094:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.017102:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 12 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.017108:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520969088:0@lo:104: 00000100:00100000:3.0:1783141722.017126:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141722.017213:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.017220:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 12 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.017227:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520969216:0@lo:104: 00000100:00100000:3.0:1783141722.017245:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.024514:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set 0000000059a354c7 going to sleep for 11 seconds 00000100:00100000:0.0:1783141722.026847:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520968960 00000100:00100000:0.0:1783141722.026862:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520968960 00000100:00100000:0.0:1783141722.026922:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969088 00000100:00100000:0.0:1783141722.026939:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969088 00000100:00100000:0.0:1783141722.026954:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969216 00000100:00100000:0.0:1783141722.026956:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969216 00000100:00100000:0.0:1783141722.026969:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141722.026975:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007744a53a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520968960:12345-0@lo:104: 00010000:00010000:0.0:1783141722.026991:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.027183:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141722.027188:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007744a53a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520968960:12345-0@lo:104: Request processed in 213us (10155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.027196:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141722.027212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141722.027218:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5bf79d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520969088:12345-0@lo:104: 00010000:00010000:0.0:1783141722.027226:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030592:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141722.030605:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030618:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032524808 already unused, calling callback (000000008078156d) 10000000:00010000:2.0:1783141722.030621:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030630:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141722.030636:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.030642:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141722.030690:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030697:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141722.030725:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030732:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 0000000032524808/0xb31399d6a380697a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806981 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030889:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141722.030892:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030898:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab29656e already unused, calling callback (000000008078156d) 10000000:00010000:2.0:1783141722.030914:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030920:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141722.030925:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.030930:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141722.030955:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030960:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141722.030975:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030982:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000ab29656e/0xb31399d6a380690a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806911 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.030991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141722.030993:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141722.030994:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141722.031003:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141722.031022:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520969344:0@lo:103: 00000100:00100000:2.0:1783141722.031090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.031146:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e87691ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520969472:0@lo:103: 00000100:00100000:2.0:1783141722.031170:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.031203:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969344 00000100:00100000:2.0:1783141722.031210:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969344 00010000:00010000:2.0:1783141722.031244:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 13 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.031268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969472 00000100:00100000:2.0:1783141722.031316:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969472 00010000:00010000:2.0:1783141722.031328:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.031342:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141722.031349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d548fee4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520969344:12345-0@lo:103: 00010000:00010000:2.0:1783141722.031362:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141722.031368:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.031378:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.031394:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141722.031441:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d548fee4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520969344:12345-0@lo:103: Request processed in 93us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.031621:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141722.031639:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141722.031645:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d19270ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3652:x1869759520969472:12345-0@lo:103: 00010000:00010000:2.0:1783141722.031653:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141722.031656:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 13 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.031664:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 13 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.031686:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141722.031768:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d19270ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3652:x1869759520969472:12345-0@lo:103: Request processed in 123us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.031775:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141722.031819:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520969344:0@lo:103: 00010000:00010000:3.0:1783141722.031958:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a8555d0/0xb31399d6a3806981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380697a expref: 12 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.031970:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520968960:0@lo:104: 00010000:00010000:3.0:1783141722.031996:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067f2a481/0xb31399d6a3806911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380690a expref: 11 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.032005:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520969088:0@lo:104: 00010000:00010000:0.0:1783141722.032072:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1783141722.032079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5bf79d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520969088:12345-0@lo:104: Request processed in 4862us (14951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.032088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141722.032104:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141722.032111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019c034ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520969216:12345-0@lo:104: 00010000:00010000:0.0:1783141722.032121:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032173:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141722.032177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019c034ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520969216:12345-0@lo:104: Request processed in 69us (14932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.032191:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783141722.032211:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141722.032213:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002141c49d already unused, calling callback (000000008078156d) 10000000:00010000:0.0:1783141722.032222:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032229:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141722.032235:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141722.032240:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141722.032262:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032268:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141722.032316:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032322:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 000000002141c49d/0xb31399d6a38068ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38068f5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032334:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141722.032335:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141722.032336:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141722.032345:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520969600:0@lo:103: 00000100:00100000:0.0:1783141722.032382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.032552:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520969216:0@lo:104: 00010000:00010000:3.0:1783141722.032569:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.032626:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969600 00000100:00100000:0.0:1783141722.032631:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969600 00010000:00010000:0.0:1783141722.032646:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 11 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.032722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141722.032827:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141722.032835:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7eac5ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:3653:x1869759520969600:12345-0@lo:103: 00010000:00010000:0.0:1783141722.032843:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141722.032846:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 11 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032854:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 11 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032863:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006798b6b3/0xb31399d6a38068f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38068ee expref: 11 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032874:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032880:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032891:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032896:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032901:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032912:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032917:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ace943dd already unused, calling callback (00000000f5761fd1) 00010000:00010000:0.0:1783141722.032920:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032926:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032943:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.032951:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141722.032976:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7eac5ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:3653:x1869759520969600:12345-0@lo:103: Request processed in 144us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.032983:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783141722.033016:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.033023:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.033028:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ace943dd/0xb31399d6a38069c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141722.033042:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783141722.033186:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e87691ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520969472:0@lo:103: 00000100:00100000:1.0:1783141722.033341:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6bad3b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520969600:0@lo:103: 00000100:00100000:2.0:1783141722.039452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000732dbbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:7452:x1869759520968832:12345-0@lo:253: Request processed in 59800us (60535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.039469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141722.040566:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ee2b7d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520968832:0@lo:253: 10000000:01000000:0.0:1783141722.040584:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783141722.040587:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141722.040589:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783141722.040591:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141722.040592:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1783141722.040593:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141722.040594:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141722.040595:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783141722.040597:0:7452:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783141722.040599:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141722.040600:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783141722.040620:0:7452:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004ef28afb from lustre-MDT0001 10000000:01000000:0.0:1783141722.040653:0:7452:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1783141722.040665:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783141722.040672:0:7452:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9c48c28000 local copy 10000000:01000000:0.0:1783141722.040676:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783141722.040709:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.040719:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.040726:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.040752:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000007ac5883 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969728:0@lo:101: 00000100:00100000:0.0:1783141722.040803:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.040847:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a2ee6f25 going to sleep for 11 seconds 00000100:00100000:3.0:1783141722.040983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969728 00000100:00100000:3.0:1783141722.040996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969728 00000100:00100000:3.0:1783141722.041051:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141722.041059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ea646a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:7452:x1869759520969728:12345-0@lo:101: 00010000:00010000:3.0:1783141722.041072:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141722.041094:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d93a4299/0xb31399d6a38069ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38069c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.041115:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d93a4299/0xb31399d6a38069ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38069c7 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.041125:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d93a4299/0xb31399d6a38069ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069c7 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.041133:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d93a4299, rc 0) 00000100:00100000:3.0:1783141722.041173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ea646a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:7452:x1869759520969728:12345-0@lo:101: Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.041180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783141722.041621:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000007ac5883 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969728:0@lo:101: 00010000:00010000:0.0:1783141722.041634:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.041642:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.041731:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000007ac5883 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969856:0@lo:501: 00000100:00100000:0.0:1783141722.041880:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.041955:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a2ee6f25 going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.052515:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969856 00000100:00100000:2.0:1783141722.052530:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969856 00000100:00100000:3.0:1783141722.052983:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783141722.052993:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002017ebf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:7452:x1869759520969856:12345-0@lo:501: 00000100:00100000:3.0:1783141722.053141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002017ebf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:7452:x1869759520969856:12345-0@lo:501: Request processed in 149us (11261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141722.053148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141722.054415:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000007ac5883 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969856:0@lo:501: 10000000:01000000:2.0:1783141722.054444:0:7452:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783141722.054486:0:7452:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783141722.054493:0:7452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.054503:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.054523:0:7452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.054545:0:7452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783141722.054576:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c7b4fc000 10000000:01000000:2.0:1783141722.054580:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783141722.054585:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f9c48c28000 10000000:01000000:2.0:1783141722.054588:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783141722.054591:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9f9c48c28000 from 1 10000000:01000000:2.0:1783141722.054593:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783141722.054620:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.054627:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.054636:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.054651:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969984:0@lo:101: 00000100:00100000:2.0:1783141722.054700:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.054733:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000736ec2df going to sleep for 11 seconds 00010000:00010000:0.0:1783141722.054877:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141722.054882:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.054889:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c492eaaa already unused, calling callback (000000008078156d) 10000000:00010000:0.0:1783141722.054897:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.054905:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141722.054911:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141722.054917:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141722.054933:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.054938:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141722.054953:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.054958:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a38069c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a38069ce expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.054972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141722.054973:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141722.054975:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141722.055023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520969984 00000100:00100000:2.0:1783141722.055029:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520969984 00000100:00100000:2.0:1783141722.055070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141722.055076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f38d8d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:7452:x1869759520969984:12345-0@lo:101: 00010000:00010000:2.0:1783141722.055095:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141722.055118:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000085387ac/0xb31399d6a38069dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38069d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055140:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000085387ac/0xb31399d6a38069dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38069d5 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055148:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000085387ac/0xb31399d6a38069dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069d5 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055156:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000085387ac, rc 0) 00000100:00100000:2.0:1783141722.055185:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f38d8d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:7452:x1869759520969984:12345-0@lo:101: Request processed in 109us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.055192:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141722.055216:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c75d1dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520970112:0@lo:103: 00000100:00100000:2.0:1783141722.055238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.055263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970112 00000100:00100000:2.0:1783141722.055266:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970112 00000100:00100000:2.0:1783141722.055319:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141722.055324:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68d8aae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:3654:x1869759520970112:12345-0@lo:103: 00010000:00010000:2.0:1783141722.055331:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141722.055340:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d93a4299/0xb31399d6a38069ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a38069c7 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055351:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141722.055371:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68d8aae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:3654:x1869759520970112:12345-0@lo:103: Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.055378:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141722.055397:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c75d1dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520970112:0@lo:103: 00000100:00100000:2.0:1783141722.055565:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520969984:0@lo:101: 00010000:00010000:2.0:1783141722.055581:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055588:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.055601:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783141722.055641:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055647:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000ca11120c/0xb31399d6a38069d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.055655:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f9c7b4fc000 10000000:01000000:2.0:1783141722.055658:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783141722.055661:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f9c7b4fc000 from 1 10000000:01000000:2.0:1783141722.055663:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783141722.055674:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055680:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.055686:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.055696:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970240:0@lo:101: 00000100:00100000:2.0:1783141722.055719:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.055731:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000736ec2df going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.058362:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970240 00000100:00100000:2.0:1783141722.058393:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970240 00000100:00100000:2.0:1783141722.058454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141722.058462:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b001c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:7452:x1869759520970240:12345-0@lo:101: 00010000:00010000:2.0:1783141722.058477:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141722.058490:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff471af3/0xb31399d6a38069ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38069e3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.058513:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff471af3/0xb31399d6a38069ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38069e3 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.058521:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff471af3/0xb31399d6a38069ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069e3 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.058528:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff471af3, rc 0) 00000100:00100000:2.0:1783141722.058592:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b001c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:7452:x1869759520970240:12345-0@lo:101: Request processed in 131us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.058599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141722.058650:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970240:0@lo:101: 00010000:00010000:2.0:1783141722.058666:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.058675:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.058691:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783141722.061940:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.061959:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000ac8d16c8/0xb31399d6a38069e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.061984:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783141722.062078:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141722.062097:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f9c7b4fc000 10000000:01000000:3.0:1783141722.062100:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783141722.062105:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783141722.062108:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783141722.062144:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.062164:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.062174:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.062197:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970368:0@lo:101: 00000100:00100000:3.0:1783141722.062266:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.062346:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d551ea5 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.063596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970368 00000100:00100000:1.0:1783141722.063619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970368 00000100:00100000:1.0:1783141722.063671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141722.063679:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062cc678a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:7452:x1869759520970368:12345-0@lo:101: 00010000:00010000:1.0:1783141722.063695:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141722.063709:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b4d4dbe/0xb31399d6a38069f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38069f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.063731:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b4d4dbe/0xb31399d6a38069f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.063740:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b4d4dbe/0xb31399d6a38069f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.063756:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b4d4dbe, rc 0) 00000100:00100000:1.0:1783141722.063814:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062cc678a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970368:12345-0@lo:101: Request processed in 136us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.063821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141722.063976:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970368:0@lo:101: 00010000:00010000:3.0:1783141722.063993:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.064001:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.064101:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970496:0@lo:501: 00000100:00100000:3.0:1783141722.064132:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.064170:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d551ea5 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.065323:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970496 00000100:00100000:1.0:1783141722.065335:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970496 00000100:00100000:1.0:1783141722.065385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141722.065393:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049738e49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970496:12345-0@lo:501: 00000100:00100000:1.0:1783141722.065555:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049738e49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970496:12345-0@lo:501: Request processed in 163us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.065562:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783141722.065719:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970496:0@lo:501: 00000100:00100000:3.0:1783141722.065768:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970624:0@lo:503: 00000100:00100000:3.0:1783141722.065814:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.065853:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d551ea5 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.065968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970624 00000100:00100000:1.0:1783141722.065972:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970624 00000100:00100000:1.0:1783141722.066006:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141722.066013:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dfa4c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970624:12345-0@lo:503: 00000100:00100000:1.0:1783141722.066089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dfa4c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970624:12345-0@lo:503: Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.066102:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141722.066288:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970624:0@lo:503: 00000040:00080000:3.0:1783141722.066570:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141722.066644:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970752:0@lo:502: 00000100:00100000:3.0:1783141722.066680:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.066693:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d551ea5 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.066864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970752 00000100:00100000:1.0:1783141722.066869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970752 00000100:00100000:1.0:1783141722.066902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783141722.066908:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010206567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970752:12345-0@lo:502: 00000100:00100000:1.0:1783141722.066992:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010206567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970752:12345-0@lo:502: Request processed in 84us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.066999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783141722.067111:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025db6df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970752:0@lo:502: 00000040:00080000:3.0:1783141722.067364:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783141722.067391:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1783141722.067640:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1783141722.067660:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1783141722.067671:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1783141722.067681:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1783141722.067695:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1783141722.067706:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1783141722.067717:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1783141722.067729:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1783141722.067742:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1783141722.067766:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1783141722.067794:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1783141722.067809:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1783141722.067822:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1783141722.067833:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1783141722.067845:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1783141722.067857:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1783141722.067869:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1783141722.067882:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1783141722.067893:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1783141722.067904:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1783141722.067917:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1783141722.067946:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000cbb5f1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970880:0@lo:502: 00000100:00100000:1.0:1783141722.067998:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141722.068034:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000000b7c5e09 going to sleep for 11 seconds 00000100:00100000:3.0:1783141722.068157:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520970880 00000100:00100000:3.0:1783141722.068163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520970880 00000100:00100000:3.0:1783141722.068202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783141722.068209:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a89514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970880:12345-0@lo:502: 00000100:00100000:3.0:1783141722.068448:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a89514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520970880:12345-0@lo:502: Request processed in 238us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.068456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141722.068980:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000cbb5f1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520970880:0@lo:502: 00000040:00080000:3.0:1783141722.069108:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1783141722.069120:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1783141722.070677:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141722.070690:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141722.070692:0:7464:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783141722.070698:0:7464:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783141722.070702:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141722.070717:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002da809fe) 00000020:00000080:0.0:1783141722.070738:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1783141722.070744:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783141722.070884:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783141722.070897:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3806a06 00000020:00000080:0.0:1783141722.071369:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783141722.071375:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141722.071379:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141722.071381:0:7464:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783141722.071384:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141722.071388:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141722.071389:0:7464:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783141722.071393:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141722.072652:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000c0ec8b5d) 00000020:00000080:0.0:1783141722.072679:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1783141722.072690:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783141722.072692:0:7464:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783141722.072694:0:7464:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783141722.072701:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783141722.073178:0:7464:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ef28afb from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783141722.073196:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000047e45aa0) 00000020:00000080:0.0:1783141722.073207:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1783141722.077729:0:7464:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783141722.077812:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806a1b 00000020:00000080:1.0:1783141722.077978:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783141722.077986:0:7464:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783141722.077991:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb31399d6a3806a22 00080000:01000000:1.0:1783141722.077997:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783141722.078002:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3806a29 00080000:10000000:1.0:1783141722.078935:0:7464:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1783141722.079067:0:7464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1783141722.208567:0:7464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1783141722.208873:0:7464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1783141722.211042:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783141722.211577:0:7464:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783141722.239880:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783141722.239894:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141722.239900:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141722.239902:0:7464:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783141722.239905:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141722.239910:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141722.239911:0:7464:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783141722.239914:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783141722.239919:0:7464:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:1.0:1783141722.239947:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141722.239962:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000061ec27b0) 00000020:00000080:1.0:1783141722.239983:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783141722.239987:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783141722.240073:0:7464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783141722.240079:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783141722.240085:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3806a37 00010000:00080000:1.0:1783141722.240120:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000063f5c320@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141722.248618:0:7464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1783141722.250400:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141722.250484:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783141722.250519:0:7464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783141722.250538:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806a3e 00000100:00080000:2.0:1783141722.250547:0:7464:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141722.250551:0:7464:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000063f5c320 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141722.250581:0:7464:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ae35fa69 x1869759520971008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141722.250603:0:7464:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783141722.250669:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000002b2ef93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520971136:0@lo:400: 00000100:00100000:1.0:1783141722.250874:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759520971008:0@lo:38: 00000100:00100000:1.0:1783141722.250948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141722.251094:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971008 00000100:00100000:1.0:1783141722.251109:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971008 00000100:00100000:1.0:1783141722.251139:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141722.251144:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c064b750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1869759520971008:12345-0@lo:38: 00010000:00080000:1.0:1783141722.251166:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1783141722.251208:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806a45 00000004:00100000:1.0:1783141722.251221:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783141722.251227:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783141722.251556:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783141722.251636:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141722.251640:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.251642:0:7464:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1783141722.251645:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783141722.251647:0:7464:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783141722.251649:0:7464:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783141722.251651:0:7464:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783141722.251652:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783141722.251654:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.251655:0:7464:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783141722.251658:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141722.251661:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.251663:0:7464:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1783141722.251666:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783141722.252636:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971136 00000100:00100000:0.0:1783141722.252644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971136 00000100:00100000:0.0:1783141722.252707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141722.252715:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5cb4b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520971136:12345-0@lo:400: 00000100:00100000:0.0:1783141722.252904:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5cb4b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520971136:12345-0@lo:400: Request processed in 190us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.252912:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783141722.252954:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000002b2ef93 x1869759520971136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141722.252968:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000002b2ef93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520971136:0@lo:400: 00000004:01000000:2.0:1783141722.253118:0:7464:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783141722.253147:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141722.253150:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.253152:0:7464:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1783141722.253155:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141722.253157:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.253158:0:7464:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783141722.253161:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783141722.253162:0:7464:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783141722.253183:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141722.253185:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141722.253186:0:7464:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783141722.253188:0:7464:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1783141722.253562:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1783141722.253595:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783141722.253613:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.253622:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000009353f2df/0xb31399d6a38069f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141722.253630:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c7b4fc000 from 1 10000000:01000000:0.0:1783141722.253633:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141722.253660:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.253666:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.254076:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.254097:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b3508472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971264:0@lo:101: 00000100:00100000:0.0:1783141722.254141:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.254179:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000007242bed0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.254350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971264 00000100:00100000:2.0:1783141722.254355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971264 00000100:00100000:2.0:1783141722.254423:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783141722.254430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f89c490a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:7452:x1869759520971264:12345-0@lo:101: 00010000:00010000:2.0:1783141722.254443:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141722.254463:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806a4c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.254481:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.254491:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.254499:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000148b5111, rc 0) 00000100:00100000:2.0:1783141722.254534:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f89c490a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7452:x1869759520971264:12345-0@lo:101: Request processed in 104us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.254541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141722.257458:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b3508472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971264:0@lo:101: 00010000:00010000:0.0:1783141722.257484:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.257495:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.258258:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b3508472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971392:0@lo:256: 00000100:00100000:0.0:1783141722.260634:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.260718:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000007242bed0 going to sleep for 11 seconds 00000100:00080000:0.0:1783141722.261369:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000c0308cb8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141722.261554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c064b750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759520971008:12345-0@lo:38: Request processed in 10298us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.261571:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141722.261645:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971392 00000100:00100000:2.0:1783141722.261657:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971392 00000100:00100000:2.0:1783141722.261712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783141722.261719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000787e4c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7452:x1869759520971392:12345-0@lo:256: 20000000:01000000:2.0:1783141722.261744:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783141722.261760:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783141722.261763:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1783141722.261843:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000787e4c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7452:x1869759520971392:12345-0@lo:256: Request processed in 124us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.261849:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783141722.261898:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b3508472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971392:0@lo:256: 10000000:01000000:2.0:1783141722.262992:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:3.0:1783141722.263126:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783141722.263136:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783141722.263143:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783141722.263149:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783141722.263152:0:3651:0:(import.c:65:import_set_state_nolock()) 0000000063f5c320 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783141722.263172:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ae35fa69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759520971008:0@lo:38: 00000100:00100000:3.0:1783141722.263329:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e15ae42c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520971520:0@lo:41: 00000100:00100000:3.0:1783141722.263380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141722.263575:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.263587:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141722.263595:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b4fc000 from 1 10000000:01000000:2.0:1783141722.263598:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141722.263619:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.263627:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.263635:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.263647:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971648:0@lo:101: 00000100:00100000:0.0:1783141722.263769:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971520 00000100:00100000:0.0:1783141722.263775:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971520 00000100:00100000:0.0:1783141722.263814:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141722.263821:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025db6df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1869759520971520:12345-0@lo:41: 00000004:00000024:0.0:1783141722.263851:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1783141722.264187:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025db6df9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1869759520971520:12345-0@lo:41: Request processed in 366us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.264196:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141722.264265:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e15ae42c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520971520:0@lo:41: 00000100:00100000:2.0:1783141722.264986:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.265064:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f5b3f55c going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.265200:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971648 00000100:00100000:1.0:1783141722.265207:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971648 00000100:00100000:1.0:1783141722.265307:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783141722.265314:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000582498d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7452:x1869759520971648:12345-0@lo:101: 00010000:00010000:1.0:1783141722.265325:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141722.265338:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806a5a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.265358:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.265367:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.265375:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d041eaa0, rc 0) 00000100:00100000:1.0:1783141722.265423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000582498d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520971648:12345-0@lo:101: Request processed in 110us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.265430:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783141722.265613:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971648:0@lo:101: 00010000:00010000:2.0:1783141722.265627:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.265635:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.265735:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971776:0@lo:501: 00000100:00100000:2.0:1783141722.265917:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.266142:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f5b3f55c going to sleep for 11 seconds 00000100:00100000:0.0:1783141722.266185:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971776 00000100:00100000:0.0:1783141722.266190:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971776 00000100:00100000:3.0:1783141722.266234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783141722.266243:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad500ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520971776:12345-0@lo:501: 00000100:00100000:3.0:1783141722.266379:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad500ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520971776:12345-0@lo:501: Request processed in 138us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.266386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783141722.270115:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971776:0@lo:501: 00000100:00100000:2.0:1783141722.270180:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971904:0@lo:503: 00000100:00100000:2.0:1783141722.270260:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.270357:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f5b3f55c going to sleep for 11 seconds 00000100:00100000:3.0:1783141722.270539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520971904 00000100:00100000:3.0:1783141722.270546:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520971904 00000100:00100000:3.0:1783141722.270589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141722.270597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082cb6170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520971904:12345-0@lo:503: 00000040:00080000:3.0:1783141722.270644:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141722.270711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082cb6170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520971904:12345-0@lo:503: Request processed in 114us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.270718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141722.271534:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520971904:0@lo:503: 00000040:00080000:2.0:1783141722.271933:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141722.271983:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1783141722.272130:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141722.275877:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1783141722.277229:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1783141722.277301:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141722.277318:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.277330:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141722.277400:0:7452:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783141722.277403:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c7b4fc000 10000000:01000000:0.0:1783141722.277407:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c7b4fc000 10000000:01000000:0.0:1783141722.277412:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141722.277418:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b4fc000 from 1 10000000:01000000:0.0:1783141722.277434:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141722.277467:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.277475:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.277485:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.277506:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a98dd222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972032:0@lo:101: 00000100:00100000:0.0:1783141722.277577:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.277621:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000005f811732 going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.278385:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972032 00000100:00100000:2.0:1783141722.278446:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972032 00000100:00100000:2.0:1783141722.278502:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141722.278510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdea3454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7452:x1869759520972032:12345-0@lo:101: 00010000:00010000:2.0:1783141722.278525:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141722.278538:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5b890b2/0xb31399d6a3806a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806a68 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.278569:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5b890b2/0xb31399d6a3806a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.278579:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5b890b2/0xb31399d6a3806a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.278587:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5b890b2, rc 0) 00000100:00100000:2.0:1783141722.278643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdea3454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972032:12345-0@lo:101: Request processed in 134us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.278650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783141722.278833:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a98dd222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972032:0@lo:101: 00010000:00010000:3.0:1783141722.278848:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.278857:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.278959:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972160:0@lo:501: 00000100:00100000:3.0:1783141722.278990:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.279125:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018a5ef43 going to sleep for 11 seconds 00000100:00100000:0.0:1783141722.279645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972160 00000100:00100000:0.0:1783141722.279652:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972160 00000100:00100000:0.0:1783141722.279852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783141722.279861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037f17027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972160:12345-0@lo:501: 00000100:00100000:0.0:1783141722.279998:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037f17027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972160:12345-0@lo:501: Request processed in 138us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.280013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783141722.280080:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972160:0@lo:501: 00000100:00100000:3.0:1783141722.280115:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972288:0@lo:503: 00000100:00100000:3.0:1783141722.280166:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.280329:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018a5ef43 going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.280472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972288 00000100:00100000:2.0:1783141722.280478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972288 00000100:00100000:2.0:1783141722.280505:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141722.280510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f91b1c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972288:12345-0@lo:503: 00000100:00100000:2.0:1783141722.280592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f91b1c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972288:12345-0@lo:503: Request processed in 82us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.280599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783141722.280665:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972288:0@lo:503: 00000040:00080000:3.0:1783141722.280948:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141722.281141:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972416:0@lo:502: 00000100:00100000:3.0:1783141722.281177:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.281207:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000009bdac5d7 going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.281467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972416 00000100:00100000:2.0:1783141722.281472:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972416 00000100:00100000:2.0:1783141722.281495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141722.281501:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5719d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972416:12345-0@lo:502: 00000100:00100000:2.0:1783141722.281596:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5719d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972416:12345-0@lo:502: Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.281604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783141722.281691:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972416:0@lo:502: 00000040:00080000:3.0:1783141722.281877:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783141722.281903:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783141722.281919:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783141722.281931:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783141722.281944:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783141722.281956:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783141722.281967:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783141722.281978:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783141722.281989:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783141722.282186:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783141722.282207:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783141722.282221:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783141722.282234:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783141722.282247:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783141722.282316:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783141722.282334:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783141722.282347:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783141722.282361:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783141722.282375:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783141722.282401:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783141722.282416:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783141722.282430:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783141722.282454:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783141722.282468:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783141722.282481:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783141722.282493:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783141722.282505:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783141722.282518:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1783141722.282544:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972544:0@lo:502: 00000100:00100000:3.0:1783141722.282592:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.282626:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000009bdac5d7 going to sleep for 11 seconds 00000100:00100000:0.0:1783141722.282852:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972544 00000100:00100000:0.0:1783141722.282857:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972544 00000100:00100000:0.0:1783141722.282893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783141722.282900:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000010e4c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972544:12345-0@lo:502: 00000100:00100000:0.0:1783141722.283089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000010e4c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972544:12345-0@lo:502: Request processed in 189us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.283097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783141722.284137:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972544:0@lo:502: 00000040:00080000:3.0:1783141722.284211:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783141722.284223:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783141722.284905:0:7470:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783141722.284918:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000331ae028) 00000020:00000080:0.0:1783141722.284945:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783141722.285203:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ef28afb from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783141722.285207:0:7470:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004ef28afb from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783141722.285209:0:7470:0:(obd_mount.c:701:lustre_put_lsi()) put 000000004ef28afb 3 00010000:00080000:0.0:1783141722.285235:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000034f4129@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141722.289232:0:7470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1783141722.290518:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783141722.290578:0:7470:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783141722.290591:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb31399d6a3806a7d 00000100:00080000:0.0:1783141722.290604:0:7470:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141722.290608:0:7470:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000034f4129 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141722.290642:0:7470:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042469a35 x1869759520972672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141722.290721:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000042469a35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759520972672:0@lo:38: 00000100:00100000:1.0:1783141722.290807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.290951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972672 00000100:00100000:2.0:1783141722.290958:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972672 00000100:00100000:2.0:1783141722.290994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141722.291023:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc555a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759520972672:12345-0@lo:38: 00010000:00080000:2.0:1783141722.291047:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1783141722.291078:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb31399d6a3806a84 00000004:00100000:2.0:1783141722.291091:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783141722.291120:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000d7b26990 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783141722.291307:0:7470:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783141722.295176:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc555a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759520972672:12345-0@lo:38: Request processed in 4144us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.295193:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1783141722.296463:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1783141722.297173:0:7471:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:1.0:1783141722.297335:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042469a35 x1869759520972672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141722.297356:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141722.297367:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783141722.297375:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783141722.297380:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783141722.297384:0:3651:0:(import.c:65:import_set_state_nolock()) 00000000034f4129 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783141722.298125:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000042469a35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759520972672:0@lo:38: 00000020:01000000:3.0:1783141722.299095:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1783141722.299138:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141722.299157:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.299168:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000006798b6b3/0xb31399d6a3806a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783141722.299227:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783141722.299230:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783141722.299231:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141722.299232:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141722.299234:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141722.299235:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141722.299236:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141722.299238:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141722.299239:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141722.299241:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141722.299242:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141722.299246:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1783141722.299249:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141722.299255:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783141722.299256:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141722.299257:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141722.299258:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141722.299259:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141722.299259:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141722.299260:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141722.299261:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141722.299262:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141722.299263:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141722.299315:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783141722.299331:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972800:0@lo:253: 00000100:00100000:3.0:1783141722.300628:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.300722:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000009bdac5d7 going to sleep for 11 seconds 00000100:00100000:0.0:1783141722.309158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972800 00000100:00100000:0.0:1783141722.309173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972800 00000100:00100000:0.0:1783141722.309309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141722.309318:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000178656b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972800:12345-0@lo:253: 20000000:01000000:0.0:1783141722.309353:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783141722.309367:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1783141722.320540:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783141722.330876:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783141722.330951:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783141722.332483:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000178656b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:7452:x1869759520972800:12345-0@lo:253: Request processed in 23159us (31852us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.332498:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141722.332701:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004724f119 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7452:1869759520972800:0@lo:253: 10000000:01000000:0.0:1783141722.332717:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783141722.332720:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141722.332722:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783141722.332723:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141722.332724:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141722.332725:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141722.332751:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141722.332752:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783141722.332754:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141722.332755:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141722.332756:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141722.332757:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783141722.332775:0:7452:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783141722.340814:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783141722.340825:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783141722.340850:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.340869:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.340876:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.340882:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.340924:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.340938:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 14 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.340952:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520972928:0@lo:104: 00000100:00100000:2.0:1783141722.341382:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141722.342824:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141722.342842:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141722.342853:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000025054359 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520973056:0@lo:104: 00000100:00100000:2.0:1783141722.342900:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.345617:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dba94ed1 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.352582:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520972928 00000100:00100000:1.0:1783141722.352599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520972928 00000100:00100000:1.0:1783141722.352655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973056 00000100:00100000:1.0:1783141722.352659:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973056 00000100:00100000:1.0:1783141722.352689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141722.352697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5527857 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759520972928:12345-0@lo:104: 00010000:00010000:1.0:1783141722.352715:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.352814:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141722.352819:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5527857 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759520972928:12345-0@lo:104: Request processed in 124us (11440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.352826:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141722.352843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141722.352848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c915c7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520973056:12345-0@lo:104: 00010000:00010000:1.0:1783141722.352854:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.352886:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783141722.352889:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c915c7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520973056:12345-0@lo:104: Request processed in 43us (9991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.352909:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783141722.352927:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141722.352932:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.352939:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c492eaaa already unused, calling callback (000000008078156d) 10000000:00010000:1.0:1783141722.352943:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.352950:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141722.352957:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141722.352962:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141722.352994:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353000:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141722.353019:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353025:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000c492eaaa/0xb31399d6a3806a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a53 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353039:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141722.353041:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353056:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052697d95 already unused, calling callback (000000008078156d) 10000000:00010000:1.0:1783141722.353058:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353064:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141722.353069:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141722.353074:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141722.353086:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353091:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141722.353104:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353110:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 0000000052697d95/0xb31399d6a38069a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141722.353121:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141722.353123:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141722.353124:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141722.353136:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fae5597b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520973184:0@lo:103: 00000100:00100000:1.0:1783141722.353173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141722.353230:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141722.353237:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520973312:0@lo:103: 00000100:00100000:1.0:1783141722.353310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783141722.353331:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141722.353347:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973184 00000100:00100000:1.0:1783141722.353352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973184 00010000:00010000:1.0:1783141722.353370:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 15 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141722.353546:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973312 00000100:00100000:1.0:1783141722.353551:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973312 00010000:00010000:1.0:1783141722.353563:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.358586:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bffd0707 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520972928:0@lo:104: 00000100:00100000:3.0:1783141722.358602:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000025054359 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520973056:0@lo:104: 00010000:00010000:3.0:1783141722.358625:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.359420:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141722.359440:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c51d439a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3653:x1869759520973184:12345-0@lo:103: 00010000:00010000:0.0:1783141722.359460:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141722.359467:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359480:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359496:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000148b5111/0xb31399d6a3806a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806a4c expref: 16 pid: 6515 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359511:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141722.359597:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c51d439a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3653:x1869759520973184:12345-0@lo:103: Request processed in 167us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.359605:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141722.359629:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141722.359636:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045c92ded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3655:x1869759520973312:12345-0@lo:103: 00010000:00010000:0.0:1783141722.359643:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141722.359647:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359655:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359677:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000118c464/0xb31399d6a38069ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38069a4 expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359688:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359696:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783141722.359709:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018884896s 00010000:00010000:0.0:1783141722.359713:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359719:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359724:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359729:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359734:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003fb0de23 already unused, calling callback (00000000f5761fd1) 00010000:00010000:0.0:1783141722.359737:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141722.359774:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fae5597b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520973184:0@lo:103: 00010000:00010000:0.0:1783141722.359912:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359933:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141722.359956:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141722.360074:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045c92ded pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3655:x1869759520973312:12345-0@lo:103: Request processed in 438us (6802us total) trans 0 rc 0/0 00010000:00010000:3.0:1783141722.360076:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141722.360088:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783141722.360092:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141722.360099:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003fb0de23/0xb31399d6a3806a8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141722.360959:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520973312:0@lo:103: 00080000:10000000:1.0:1783141722.362872:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1783141722.363042:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1783141722.363250:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1783141722.363472:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1783141722.363684:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1783141722.363847:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1783141722.365830:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783141722.366134:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1783141722.366353:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1783141722.366514:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1783141722.366686:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1783141722.366857:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1783141722.370695:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1783141722.375535:0:7476:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783141722.375563:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1783141722.379504:0:7475:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783141722.379514:0:7475:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783141722.379670:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000947fb4f6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1869759520973440:0@lo:700: 00000100:00100000:2.0:1783141722.379742:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.379803:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973440 00000100:00100000:2.0:1783141722.379809:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973440 00000100:00100000:2.0:1783141722.379853:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141722.379860:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d548fee4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1869759520973440:12345-0@lo:700: 00000100:00100000:2.0:1783141722.380066:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f5b3f55c going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.383457:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d19270ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973568:0@lo:1000: 00000100:00100000:2.0:1783141722.383533:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.383572:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 000000006eae9906 going to sleep for 11 seconds 00000040:01000000:3.0:1783141722.383800:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783141722.383916:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783141722.384397:0:7452:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783141722.384405:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783141722.384529:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141722.385620:0:7452:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1783141722.385809:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973568 00000100:00100000:0.0:1783141722.385818:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973568 00000100:00100000:0.0:1783141722.385948:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141722.385958:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68d8aae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973568:12345-0@lo:1000: 00000100:00100000:0.0:1783141722.386911:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68d8aae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973568:12345-0@lo:1000: Request processed in 951us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.386920:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141722.387259:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d19270ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973568:0@lo:1000: 00000040:01000000:2.0:1783141722.387323:0:7477:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1783141722.387359:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d19270ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973696:0@lo:700: 00000100:00100000:2.0:1783141722.387410:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141722.387462:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 000000007d2f9d8a going to sleep for 11 seconds 00000040:00080000:3.0:1783141722.390834:0:7452:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783141722.390909:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783141722.392876:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783141722.393092:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783141722.393943:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783141722.394105:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783141722.394711:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783141722.394862:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783141722.394997:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783141722.395128:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783141722.395391:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783141722.395810:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783141722.395940:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783141722.396077:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783141722.396316:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783141722.396498:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783141722.396821:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783141722.396969:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783141722.397096:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783141722.397327:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783141722.397801:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783141722.397935:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783141722.398062:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783141722.398298:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783141722.398614:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783141722.398748:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783141722.398880:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783141722.399069:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783141722.399318:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783141722.399537:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783141722.399674:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783141722.399809:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783141722.399919:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783141722.400044:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783141722.400171:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783141722.400493:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783141722.400692:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783141722.400959:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973696 00000100:00100000:3.0:1783141722.400967:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973696 00000100:00100000:3.0:1783141722.401018:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141722.401026:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025054359 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973696:12345-0@lo:700: 00000100:00100000:3.0:1783141722.401118:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025054359 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973696:12345-0@lo:700: Request processed in 93us (13708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141722.401126:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:2.0:1783141722.402695:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1783141722.402890:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d19270ed pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973696:0@lo:700: 00000100:00100000:0.0:1783141722.402967:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1869759520973824:0@lo:900: 00000100:00100000:0.0:1783141722.403023:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.403734:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c2222caa going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.404026:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973824 00000100:00100000:1.0:1783141722.404035:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973824 00000100:00100000:1.0:1783141722.404080:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141722.404098:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7eac5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1869759520973824:12345-0@lo:900: 00000100:00100000:1.0:1783141722.404159:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7eac5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1869759520973824:12345-0@lo:900: Request processed in 62us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.404167:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783141722.404574:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bd4dadd3 x1869759520973824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783141738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141722.404590:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1869759520973824:0@lo:900: 00000100:00100000:0.0:1783141722.404709:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973952:0@lo:1000: 00000100:00100000:0.0:1783141722.404910:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.404954:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 0000000078803e49 going to sleep for 11 seconds 00000100:00100000:3.0:1783141722.405024:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520973952 00000100:00100000:3.0:1783141722.405030:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520973952 00000100:00100000:0.0:1783141722.409963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141722.409999:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb47ab31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973952:12345-0@lo:1000: 00000100:00100000:0.0:1783141722.410489:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb47ab31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520973952:12345-0@lo:1000: Request processed in 512us (5579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141722.410505:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141722.410569:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520973952:0@lo:1000: 00000004:00080000:0.0:1783141722.410632:0:7477:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c2222caa with version 0 00000020:00100000:0.0:1783141722.410653:0:7477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783141722.410659:0:7477:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bd4dadd3 x1869759520974208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141722.410679:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520974208:0@lo:1000: 00000100:00100000:0.0:1783141722.410713:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.410738:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974208 00000100:00100000:0.0:1783141722.410743:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974208 00000100:00100000:0.0:1783141722.410775:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141722.410782:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b50bf33b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520974208:12345-0@lo:1000: 00000100:00100000:0.0:1783141722.411749:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 000000000a22a9ab going to sleep for 11 seconds 00000001:00080000:0.0:1783141722.418150:0:7452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783141722.418199:0:7452:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1741df3988 00100000:10000000:0.0:1783141722.418208:0:7452:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783141722.419847:0:7452:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783141722.419883:0:7452:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783141722.419903:0:7452:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783141722.419919:0:7452:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783141722.422847:0:7452:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141722.423010:0:7452:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1783141722.425558:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1783141722.426009:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b50bf33b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520974208:12345-0@lo:1000: Request processed in 15224us (15292us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783141722.426022:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141722.428463:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d548fee4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1869759520973440:12345-0@lo:700: Request processed in 48599us (48716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141722.428488:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783141722.428536:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000947fb4f6 x1869759520973440/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783141738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141722.428550:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000947fb4f6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1869759520973440:0@lo:700: 40000000:02000000:2.0:1783141722.428563:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:3.0:1783141722.449529:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783141722.449538:0:7477:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783141722.449554:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bd4dadd3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520974208:0@lo:1000: 00000100:00100000:3.0:1783141722.449646:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520974336:0@lo:1000: 00000100:00100000:3.0:1783141722.449709:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141722.449793:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f46c37c4 going to sleep for 11 seconds 00000100:00100000:1.0:1783141722.451462:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974336 00000100:00100000:1.0:1783141722.451475:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974336 00000100:00100000:1.0:1783141722.452641:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141722.452654:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000047e0865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520974336:12345-0@lo:1000: 00000100:00100000:1.0:1783141722.452788:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000047e0865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869759520974336:12345-0@lo:1000: Request processed in 137us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141722.452796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141722.453033:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869759520974336:0@lo:1000: 00000040:00080000:3.0:1783141722.453061:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783141722.453099:0:7477:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008686e776 with version 1 00000040:00080000:3.0:1783141722.455152:0:7477:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783141722.455233:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783141722.455529:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bae99c25 version 1 rpc_version 1 00000020:00100000:0.0:1783141722.455566:0:7467:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783141722.455576:0:7467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e42892a2 x1869759520974592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141722.455606:0:7467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e42892a2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1869759520974592:0@lo:1000: 00000100:00100000:0.0:1783141722.455672:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141722.459568:0:7467:0:(client.c:2701:ptlrpc_set_wait()) set 000000001e8aa7af going to sleep for 11 seconds 00000100:00100000:2.0:1783141722.461465:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974592 00000100:00100000:2.0:1783141722.461479:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974592 00000100:00100000:2.0:1783141722.461531:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141722.461539:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008780f5cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1869759520974592:12345-0@lo:1000: 00000001:00080000:2.0:1783141722.465875:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1783141722.465997:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008780f5cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1869759520974592:12345-0@lo:1000: Request processed in 4456us (10322us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783141722.466010:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1783141722.469583:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1783141722.469594:0:7467:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783141722.469613:0:7467:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e42892a2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1869759520974592:0@lo:1000: 00000040:00080000:2.0:1783141722.490250:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141722.516004:0:7476:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783141722.516081:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783141722.516086:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1783141723.012421:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141724.037192:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141725.061356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141726.085472:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141726.846973:0:7722:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141727.108767:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141727.495610:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520974720:0@lo:400: 00000100:00100000:1.0:1783141727.495686:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141727.495750:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520974976:0@lo:41: 00000100:00100000:1.0:1783141727.495778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141727.496607:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000582c5a8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520975104:0@lo:400: 00000100:00100000:3.0:1783141727.496654:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141727.496696:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005041a170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520974848:0@lo:400: 00000100:00100000:3.0:1783141727.496716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141727.496740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975104 00000100:00100000:3.0:1783141727.496746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975104 00000100:00100000:3.0:1783141727.496781:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974848 00000100:00100000:3.0:1783141727.496789:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974848 00000100:00100000:3.0:1783141727.496805:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141727.496811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023769195 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520975104:12345-0@lo:400: 00000100:00100000:3.0:1783141727.496856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023769195 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520975104:12345-0@lo:400: Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.496862:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141727.496875:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141727.496879:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d144137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520974848:12345-0@lo:400: 00000100:00100000:3.0:1783141727.496901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d144137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520974848:12345-0@lo:400: Request processed in 22us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.496906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783141727.496933:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005041a170 x1869759520974848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141727.496945:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005041a170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520974848:0@lo:400: 00010000:00080000:3.0:1783141727.496964:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000582c5a8f x1869759520975104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141727.496972:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000582c5a8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520975104:0@lo:400: 00000100:00100000:0.0:1783141727.498318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974976 00000100:00100000:0.0:1783141727.498329:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974976 00000100:00100000:0.0:1783141727.498376:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141727.498385:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066784e48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520974976:12345-0@lo:41: 00000004:00000024:0.0:1783141727.498491:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1783141727.498558:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066784e48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520974976:12345-0@lo:41: Request processed in 175us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.498566:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141727.498589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520974720 00000100:00100000:0.0:1783141727.498593:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520974720 00000100:00100000:0.0:1783141727.498618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141727.498626:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eadfc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3655:x1869759520974720:12345-0@lo:400: 00000100:00100000:0.0:1783141727.498660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eadfc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3655:x1869759520974720:12345-0@lo:400: Request processed in 36us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.498667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783141727.498780:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520974976:0@lo:41: 00000100:00100000:1.0:1783141727.498826:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bfeacf9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520974720:0@lo:400: 00000020:00000004:1.0:1783141727.611024:0:7774:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783141727.611205:0:7774:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141728.132493:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141729.156516:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141730.184537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783141730.210625:0:7875:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783141730.211569:0:7875:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141731.205781:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141731.206896:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3823b1d0 20000000:00000080:1.0:1783141731.206911:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c7c5da400 uarg=0000000000000000 20000000:01000000:1.0:1783141731.206954:0:7923:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783141731.206961:0:7923:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783141731.206966:0:7923:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783141731.207266:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783141731.207440:0:7923:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783141731.217171:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141731.218034:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783141731.218071:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783141731.218091:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783141731.218108:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783141731.218125:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218142:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380696c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218149:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218155:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218193:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218205:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 12 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.218218:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1869759520975232:0@lo:104: 00000100:00100000:1.0:1783141731.218323:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141731.218804:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.218813:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 12 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.218822:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f37cfd6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1869759520975360:0@lo:104: 00000100:00100000:1.0:1783141731.218844:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set 000000003dbe9f98 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.221799:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783141731.221845:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.221882:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975232 00000100:00100000:3.0:1783141731.221890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975232 00000100:00100000:3.0:1783141731.221931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975360 00000100:00100000:3.0:1783141731.221934:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975360 00000100:00100000:3.0:1783141731.221948:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141731.221954:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e292e13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:7923:x1869759520975232:12345-0@lo:104: 00010000:00010000:3.0:1783141731.221984:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.222066:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783141731.222072:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e292e13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:7923:x1869759520975232:12345-0@lo:104: Request processed in 118us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.222079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141731.222120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141731.222126:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000582c5a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:7923:x1869759520975360:12345-0@lo:104: 00010000:00010000:3.0:1783141731.222132:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.222176:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783141731.222181:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000582c5a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:7923:x1869759520975360:12345-0@lo:104: Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.222186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783141731.222423:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141731.222427:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222447:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000163079c0 already unused, calling callback (000000008078156d) 10000000:00010000:0.0:1783141731.222450:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222459:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141731.222465:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141731.222471:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141731.222502:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222509:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141731.222537:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222544:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000163079c0/0xb31399d6a3806a5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a61 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222560:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141731.222562:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222568:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d967fe9 already unused, calling callback (000000008078156d) 10000000:00010000:0.0:1783141731.222570:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222587:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141731.222593:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141731.222599:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141731.222612:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222619:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141731.222632:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222638:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 000000004d967fe9/0xb31399d6a380696c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806973 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222650:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141731.222651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141731.222652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141731.222660:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141731.222686:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e42892a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520975488:0@lo:103: 00000100:00100000:0.0:1783141731.222725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.222770:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000036c5789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520975616:0@lo:103: 00000100:00100000:0.0:1783141731.222792:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.222823:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975488 00000100:00100000:0.0:1783141731.222827:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975488 00010000:00010000:0.0:1783141731.222846:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 13 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141731.222878:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975616 00000100:00100000:0.0:1783141731.222881:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975616 00010000:00010000:0.0:1783141731.222893:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 14 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141731.222905:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141731.222910:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4dadd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520975488:12345-0@lo:103: 00010000:00010000:0.0:1783141731.222920:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141731.222923:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 14 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222933:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 14 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.222949:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141731.222974:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4dadd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520975488:12345-0@lo:103: Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.222981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141731.222994:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141731.222999:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042469a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3652:x1869759520975616:12345-0@lo:103: 00010000:00010000:0.0:1783141731.223006:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141731.223009:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 13 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223016:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 13 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223027:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223040:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223053:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223059:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223065:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223071:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223076:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008af70807 already unused, calling callback (00000000f5761fd1) 00010000:00010000:0.0:1783141731.223079:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223085:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223092:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141731.223100:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141731.223126:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042469a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3652:x1869759520975616:12345-0@lo:103: Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.223132:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141731.223179:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000036c5789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520975616:0@lo:103: 00000100:00100000:0.0:1783141731.223212:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e42892a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520975488:0@lo:103: 00010000:00010000:2.0:1783141731.223709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141731.223736:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d041eaa0/0xb31399d6a3806a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806a5a expref: 12 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.223748:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb80e562 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1869759520975232:0@lo:104: 00010000:00010000:2.0:1783141731.223758:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041349d41/0xb31399d6a3806973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380696c expref: 11 pid: 6515 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.223776:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f37cfd6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1869759520975360:0@lo:104: 00010000:00010000:2.0:1783141731.223791:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.223799:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.223805:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.223810:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008af70807/0xb31399d6a3806a92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141731.256368:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783141731.256376:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c7b4fc000 from 4 10000000:01000000:3.0:1783141731.256381:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783141731.256425:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.256435:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.256444:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141731.256465:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007744a53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520975744:0@lo:101: 00000100:00100000:3.0:1783141731.256540:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.257199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975744 00000100:00100000:1.0:1783141731.257208:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975744 00000100:00100000:1.0:1783141731.257303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783141731.257311:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a607deb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:6519:x1869759520975744:12345-0@lo:101: 00010000:00010000:1.0:1783141731.257325:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141731.257338:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000479c8af1/0xb31399d6a3806aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806a99 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.257358:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000479c8af1/0xb31399d6a3806aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.257367:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000479c8af1/0xb31399d6a3806aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.257375:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000479c8af1, rc 0) 00000100:00100000:1.0:1783141731.257423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a607deb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520975744:12345-0@lo:101: Request processed in 114us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.257430:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783141731.257523:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c2189a3b going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.257546:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007744a53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520975744:0@lo:101: 00010000:00010000:3.0:1783141731.257560:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.257568:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141731.257636:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007744a53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520975872:0@lo:256: 00000100:00100000:3.0:1783141731.257669:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.257806:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c2189a3b going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.257866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520975872 00000100:00100000:1.0:1783141731.257870:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520975872 00000100:00100000:1.0:1783141731.257908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141731.257915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fdeef4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520975872:12345-0@lo:256: 20000000:01000000:1.0:1783141731.257928:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783141731.257946:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783141731.257949:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1783141731.258028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fdeef4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520975872:12345-0@lo:256: Request processed in 107us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.258035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141731.258066:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007744a53a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520975872:0@lo:256: 10000000:01000000:1.0:1783141731.258111:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141731.258117:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258124:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 0000000087c5e281/0xb31399d6a3806a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141731.258133:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141731.258134:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b4fc000 from 1 10000000:01000000:1.0:1783141731.258137:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141731.258154:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000006d62983a/0xb31399d6a3806aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258160:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000006d62983a/0xb31399d6a3806aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258167:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000006d62983a/0xb31399d6a3806aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.258178:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976000:0@lo:101: 00000100:00100000:1.0:1783141731.258203:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.258216:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018871184 going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.258236:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976000 00000100:00100000:1.0:1783141731.258239:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976000 00000100:00100000:1.0:1783141731.258256:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783141731.258261:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cb797bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+12:6519:x1869759520976000:12345-0@lo:101: 00010000:00010000:1.0:1783141731.258268:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141731.258298:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a21961df/0xb31399d6a3806aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806aa7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258323:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a21961df/0xb31399d6a3806aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258330:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a21961df/0xb31399d6a3806aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258336:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a21961df, rc 0) 00000100:00100000:1.0:1783141731.258363:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cb797bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976000:12345-0@lo:101: Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.258369:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783141731.258398:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976000:0@lo:101: 00010000:00010000:1.0:1783141731.258408:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000006d62983a/0xb31399d6a3806aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.258414:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000006d62983a/0xb31399d6a3806aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.258461:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976128:0@lo:501: 00000100:00100000:1.0:1783141731.258485:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.258505:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018871184 going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.258516:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976128 00000100:00100000:1.0:1783141731.258519:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976128 00000100:00100000:1.0:1783141731.258537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141731.258541:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ba9b234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976128:12345-0@lo:501: 00000100:00100000:1.0:1783141731.258821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ba9b234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976128:12345-0@lo:501: Request processed in 279us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.258828:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141731.258868:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976128:0@lo:501: 00000100:00100000:1.0:1783141731.258993:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976256:0@lo:503: 00000100:00100000:1.0:1783141731.259033:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.259047:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 0000000018871184 going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.259060:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976256 00000100:00100000:1.0:1783141731.259064:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976256 00000100:00100000:1.0:1783141731.259082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141731.259087:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003af3ecfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976256:12345-0@lo:503: 00000100:00100000:1.0:1783141731.259155:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003af3ecfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976256:12345-0@lo:503: Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.259162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141731.259198:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8d9dacd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976256:0@lo:503: 00000100:00100000:3.0:1783141731.262809:0:7925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5bf79d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7925:1869759520976384:0@lo:502: 00000100:00100000:3.0:1783141731.262909:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.262957:0:7925:0:(client.c:2701:ptlrpc_set_wait()) set 000000003fbfbd3c going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.263047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976384 00000100:00100000:0.0:1783141731.263054:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976384 00000100:00100000:0.0:1783141731.263100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783141731.263107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a9cca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7925:x1869759520976384:12345-0@lo:502: 00000100:00100000:0.0:1783141731.263215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a9cca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7925:x1869759520976384:12345-0@lo:502: Request processed in 108us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.263222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783141731.266197:0:7925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5bf79d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7925:1869759520976384:0@lo:502: 00000020:01000000:3.0:1783141731.266251:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141731.266262:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141731.266265:0:7925:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783141731.266302:0:7925:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c7b4fc000 00000020:00000080:3.0:1783141731.266305:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783141731.266360:0:7925:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7925:1869759520976512:0@lo:502: 00000100:00100000:3.0:1783141731.266432:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.266473:0:7925:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49ac4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.266866:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976512 00000100:00100000:0.0:1783141731.266873:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976512 00000100:00100000:0.0:1783141731.266944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783141731.266952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7925:x1869759520976512:12345-0@lo:502: 00000100:00100000:0.0:1783141731.267076:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:7925:x1869759520976512:12345-0@lo:502: Request processed in 123us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.267084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783141731.267320:0:7925:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7925:1869759520976512:0@lo:502: 00000020:01000000:3.0:1783141731.267344:0:7925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141731.267349:0:7925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141731.267356:0:7925:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783141731.267361:0:7925:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783141731.267597:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783141731.267623:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141731.267632:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.267643:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141731.267653:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783141731.267656:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c4bd6c000 from 21 10000000:01000000:2.0:1783141731.267658:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783141731.267809:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.267818:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.267837:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.267854:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976640:0@lo:101: 00000100:00100000:2.0:1783141731.267901:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.267936:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.268068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976640 00000100:00100000:3.0:1783141731.268074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976640 00000100:00100000:3.0:1783141731.268107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783141731.268115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:6519:x1869759520976640:12345-0@lo:101: 00010000:00010000:3.0:1783141731.268125:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141731.268137:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806ab5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.268157:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.268166:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.268174:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2000, rc 0) 00000100:00100000:3.0:1783141731.268215:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520976640:12345-0@lo:101: Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.268222:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783141731.268312:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976640:0@lo:101: 00010000:00010000:2.0:1783141731.268324:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.268332:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.268384:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976768:0@lo:501: 00000100:00100000:2.0:1783141731.268408:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.268424:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.268741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976768 00000100:00100000:0.0:1783141731.268746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976768 00000100:00100000:0.0:1783141731.268780:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783141731.268787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520976768:12345-0@lo:501: 00000100:00100000:0.0:1783141731.269001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520976768:12345-0@lo:501: Request processed in 214us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.269009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783141731.269510:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976768:0@lo:501: 00000100:00100000:2.0:1783141731.269543:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976896:0@lo:503: 00000100:00100000:2.0:1783141731.269668:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.269779:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.270035:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520976896 00000100:00100000:3.0:1783141731.270040:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520976896 00000100:00100000:3.0:1783141731.270080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783141731.270088:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520976896:12345-0@lo:503: 00000100:00100000:3.0:1783141731.270183:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520976896:12345-0@lo:503: Request processed in 96us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.270190:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783141731.275391:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520976896:0@lo:503: 00000100:00100000:2.0:1783141731.280995:0:7927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7927:1869759520977024:0@lo:502: 00000100:00100000:2.0:1783141731.281087:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.281137:0:7927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.281188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977024 00000100:00100000:3.0:1783141731.281196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977024 00000100:00100000:3.0:1783141731.281264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783141731.281332:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7927:x1869759520977024:12345-0@lo:502: 00000100:00100000:3.0:1783141731.281460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7927:x1869759520977024:12345-0@lo:502: Request processed in 187us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.281468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783141731.281644:0:7927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7927:1869759520977024:0@lo:502: 00000100:00100000:1.0:1783141731.281701:0:7927:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7927:1869759520977152:0@lo:502: 00000100:00100000:1.0:1783141731.281737:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.281770:0:7927:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.281923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977152 00000100:00100000:2.0:1783141731.281932:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977152 00000100:00100000:2.0:1783141731.281967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783141731.281974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7927:x1869759520977152:12345-0@lo:502: 00000100:00100000:2.0:1783141731.282060:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:7927:x1869759520977152:12345-0@lo:502: Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.282067:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783141731.282191:0:7927:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7927:1869759520977152:0@lo:502: 00000040:00080000:1.0:1783141731.282210:0:7927:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1783141731.282391:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1783141731.282416:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141731.282426:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.282438:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141731.282664:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783141731.282668:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c4bd6c000 from 4 10000000:01000000:2.0:1783141731.282681:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783141731.282708:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.282717:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.282726:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.282741:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977280:0@lo:101: 00000100:00100000:2.0:1783141731.282777:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.282814:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.282963:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977280 00000100:00100000:3.0:1783141731.282968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977280 00000100:00100000:3.0:1783141731.283009:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783141731.283017:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520977280:12345-0@lo:101: 00010000:00010000:3.0:1783141731.283028:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141731.283046:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806ac3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.283069:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.283082:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141731.283091:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2a00, rc 0) 00000100:00100000:3.0:1783141731.283137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520977280:12345-0@lo:101: Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.283152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783141731.283331:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977280:0@lo:101: 00010000:00010000:1.0:1783141731.283344:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.283354:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.283407:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977408:0@lo:256: 00000100:00100000:1.0:1783141731.283438:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.283461:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.283512:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977408 00000100:00100000:2.0:1783141731.283517:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977408 00000100:00100000:2.0:1783141731.283548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783141731.283555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520977408:12345-0@lo:256: 20000000:01000000:2.0:1783141731.283569:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783141731.283596:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783141731.283600:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783141731.283676:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520977408:12345-0@lo:256: Request processed in 121us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.283817:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783141731.283880:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977408:0@lo:256: 10000000:01000000:1.0:1783141731.283988:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141731.283995:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.284003:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141731.284011:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783141731.284013:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1783141731.284015:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783141731.284033:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.284041:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.284049:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.284061:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977536:0@lo:101: 00000100:00100000:1.0:1783141731.284086:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.284107:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.284147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977536 00000100:00100000:2.0:1783141731.284151:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977536 00000100:00100000:2.0:1783141731.284184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783141731.284191:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520977536:12345-0@lo:101: 00010000:00010000:2.0:1783141731.284200:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141731.284209:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806ad1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.284223:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.284243:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.284251:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:2.0:1783141731.284310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520977536:12345-0@lo:101: Request processed in 119us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.284316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141731.284790:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977536:0@lo:101: 00010000:00010000:1.0:1783141731.284809:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.284818:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.284872:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977664:0@lo:501: 00000100:00100000:1.0:1783141731.284965:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.285003:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.285202:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977664 00000100:00100000:3.0:1783141731.285208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977664 00000100:00100000:3.0:1783141731.285263:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141731.285286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520977664:12345-0@lo:501: 00000100:00100000:3.0:1783141731.285419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520977664:12345-0@lo:501: Request processed in 149us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.285426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783141731.288597:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977664:0@lo:501: 00000100:00100000:1.0:1783141731.288659:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977792:0@lo:503: 00000100:00100000:1.0:1783141731.288851:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.289217:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.289266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977792 00000100:00100000:2.0:1783141731.289375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977792 00000100:00100000:2.0:1783141731.289426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783141731.289435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520977792:12345-0@lo:503: 00000100:00100000:2.0:1783141731.289558:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520977792:12345-0@lo:503: Request processed in 122us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.289566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783141731.289953:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520977792:0@lo:503: 00000100:00100000:2.0:1783141731.294133:0:7928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7928:1869759520977920:0@lo:502: 00000100:00100000:2.0:1783141731.294248:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.294318:0:7928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.294566:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520977920 00000100:00100000:0.0:1783141731.294574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520977920 00000100:00100000:0.0:1783141731.295018:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141731.295030:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:7928:x1869759520977920:12345-0@lo:502: 00000100:00100000:0.0:1783141731.295189:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:7928:x1869759520977920:12345-0@lo:502: Request processed in 161us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.295196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783141731.295945:0:7928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7928:1869759520977920:0@lo:502: 00000020:01000000:2.0:1783141731.295977:0:7928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141731.295989:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141731.295991:0:7928:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783141731.295997:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783141731.296002:0:7928:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:2.0:1783141731.296028:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141731.296043:0:7928:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f9c7b663380) 00000020:00000080:2.0:1783141731.296064:0:7928:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1783141731.296070:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783141731.296159:0:7928:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783141731.296165:0:7928:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783141731.296172:0:7928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3806ae6 00010000:00080000:2.0:1783141731.296200:0:7928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c7c5a2800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1783141731.299967:0:7928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1783141731.304868:0:7928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783141731.304882:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783141731.304921:0:7928:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783141731.304941:0:7928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806aed 00000100:00080000:2.0:1783141731.304952:0:7928:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141731.304959:0:7928:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9c7c5a2800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141731.304992:0:7928:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c4427a680 x1869759520978048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141731.305023:0:7928:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1783141731.305133:0:7928:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783141731.305268:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759520978048:0@lo:38: 00000100:00100000:1.0:1783141731.305383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.305444:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978048 00000100:00100000:1.0:1783141731.305451:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978048 00000100:00100000:1.0:1783141731.305491:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141731.305498:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1869759520978048:12345-0@lo:38: 00010000:00080000:1.0:1783141731.305528:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1783141731.305557:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806af4 00000004:00100000:1.0:1783141731.305570:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783141731.305575:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783141731.305807:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759520978176:0@lo:400: 00000100:00100000:1.0:1783141731.305860:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.305943:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520978304:0@lo:400: 00000100:00100000:0.0:1783141731.305974:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.305989:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141731.305995:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520978432:0@lo:400: 00000100:00100000:0.0:1783141731.306012:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.306173:0:6528:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783141731.306181:0:6528:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783141731.307651:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978176 00000100:00100000:3.0:1783141731.307662:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978176 00000100:00100000:3.0:1783141731.307705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978432 00000100:00100000:3.0:1783141731.307707:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978432 00000100:00100000:3.0:1783141731.307725:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141731.307733:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759520978176:12345-0@lo:400: 00000100:00080000:0.0:1783141731.307746:0:7932:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9f9c6ccc1c00 x1869759520978560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141731.307758:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aabf00 going to sleep for 0 seconds 00000020:01000000:2.0:1783141731.307890:0:7928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141731.307897:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141731.307899:0:7928:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783141731.307903:0:7928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141731.307907:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141731.307909:0:7928:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783141731.307911:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783141731.307914:0:7928:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783141731.307936:0:7928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7928:1869759520978688:0@lo:502: 00000100:00100000:2.0:1783141731.307991:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.308037:0:7928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.308066:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978304 00000100:00100000:2.0:1783141731.308071:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978304 00000100:00100000:2.0:1783141731.308158:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141731.308165:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520978304:12345-0@lo:400: 00000100:00100000:2.0:1783141731.308220:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520978304:12345-0@lo:400: Request processed in 54us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.308237:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141731.308299:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520978304:0@lo:400: 00000100:00100000:0.0:1783141731.308496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978688 00000100:00100000:0.0:1783141731.308500:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978688 00000100:00100000:0.0:1783141731.308533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141731.308540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:7928:x1869759520978688:12345-0@lo:502: 00000100:00100000:0.0:1783141731.308635:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:7928:x1869759520978688:12345-0@lo:502: Request processed in 95us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.308642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141731.311336:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783141731.311356:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783141731.311856:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759520978176:12345-0@lo:400: Request processed in 4117us (5989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.311867:0:7928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7928:1869759520978688:0@lo:502: 00000100:00100000:3.0:1783141731.311873:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141731.311904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141731.311917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520978432:12345-0@lo:400: 00000020:01000000:2.0:1783141731.311929:0:7928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141731.311938:0:7928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141731.311941:0:7928:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783141731.311948:0:7928:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1783141731.311995:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520978432:12345-0@lo:400: Request processed in 84us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.312002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783141731.312047:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6ccc0700 x1869759520978432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141731.312061:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520978432:0@lo:400: 00000020:01000000:2.0:1783141731.312081:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783141731.312112:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783141731.312122:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312132:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141731.312143:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783141731.312146:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c4bd6c000 from 1 10000000:01000000:2.0:1783141731.312149:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141731.312176:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312184:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312193:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.312210:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520978816:0@lo:101: 00000100:00100000:2.0:1783141731.312263:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.312332:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.312348:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978816 00000100:00100000:2.0:1783141731.312354:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978816 00000100:00100000:2.0:1783141731.312387:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141731.312393:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520978816:12345-0@lo:101: 00010000:00010000:2.0:1783141731.312402:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141731.312424:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806afb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312446:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806afb expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312466:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806afb expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312473:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2800, rc 0) 00000100:00100000:2.0:1783141731.312503:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520978816:12345-0@lo:101: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.312509:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141731.312543:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520978816:0@lo:101: 00010000:00010000:2.0:1783141731.312555:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.312564:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.312862:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520978944:0@lo:501: 00000100:00100000:2.0:1783141731.312890:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.312913:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.313262:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978944 00010000:00080000:1.0:1783141731.313263:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6ccc3100 x1869759520978176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141731.313268:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978944 00000100:00100000:0.0:1783141731.313344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141731.313351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520978944:12345-0@lo:501: 00000100:00100000:0.0:1783141731.313475:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520978944:12345-0@lo:501: Request processed in 124us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.313482:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783141731.313542:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520978944:0@lo:501: 00000100:00100000:2.0:1783141731.313573:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979072:0@lo:503: 00000100:00100000:2.0:1783141731.313765:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.313803:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.314048:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759520978176:0@lo:400: 00000100:00100000:0.0:1783141731.317538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979072 00000100:00100000:0.0:1783141731.317553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979072 00000100:00100000:0.0:1783141731.317609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783141731.317618:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520979072:12345-0@lo:503: 00000100:00100000:0.0:1783141731.317763:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520979072:12345-0@lo:503: Request processed in 145us (3997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.317770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783141731.318398:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979072:0@lo:503: 00000100:00100000:1.0:1783141731.318903:0:7935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7935:1869759520979200:0@lo:502: 00000100:00100000:1.0:1783141731.318961:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.319009:0:7935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.319057:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979200 00000100:00100000:2.0:1783141731.319062:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979200 00000100:00100000:2.0:1783141731.319104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783141731.319119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:7935:x1869759520979200:12345-0@lo:502: 00000100:00100000:2.0:1783141731.319235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:7935:x1869759520979200:12345-0@lo:502: Request processed in 108us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.319243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141731.319362:0:7935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7935:1869759520979200:0@lo:502: 00000020:01000000:1.0:1783141731.319384:0:7935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141731.319393:0:7935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141731.319395:0:7935:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783141731.319401:0:7935:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c4bd6c000 00000020:00000080:1.0:1783141731.319403:0:7935:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141731.319423:0:7935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7935:1869759520979328:0@lo:502: 00000100:00100000:1.0:1783141731.319458:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.319486:0:7935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a970240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.319525:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979328 00000100:00100000:2.0:1783141731.319530:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979328 00000100:00100000:2.0:1783141731.319556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783141731.319564:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:7935:x1869759520979328:12345-0@lo:502: 00000100:00100000:2.0:1783141731.319813:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:7935:x1869759520979328:12345-0@lo:502: Request processed in 249us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.319820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141731.319963:0:7935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:7935:1869759520979328:0@lo:502: 00000020:01000000:0.0:1783141731.319985:0:7935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141731.319990:0:7935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141731.319992:0:7935:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783141731.319996:0:7935:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783141731.322141:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783141731.322176:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141731.322187:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.322199:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141731.322209:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783141731.322212:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9c48c28000 from 1 10000000:01000000:2.0:1783141731.322214:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783141731.322258:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.322267:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141731.322296:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141731.322324:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979456:0@lo:101: 00000100:00100000:2.0:1783141731.322384:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.322431:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141731.322470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979456 00000100:00100000:1.0:1783141731.322478:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979456 00000100:00100000:1.0:1783141731.322526:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141731.322535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520979456:12345-0@lo:101: 00010000:00010000:1.0:1783141731.322548:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141731.322561:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806b09 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.322584:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.322607:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.322616:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168ee00, rc 0) 00000100:00100000:1.0:1783141731.322656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520979456:12345-0@lo:101: Request processed in 121us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141731.322663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141731.322810:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979456:0@lo:101: 00010000:00010000:1.0:1783141731.322824:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.322834:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141731.322893:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979584:0@lo:501: 00000100:00100000:1.0:1783141731.322923:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.322949:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b601a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.322998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979584 00000100:00100000:2.0:1783141731.323003:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979584 00000100:00100000:2.0:1783141731.323098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783141731.323107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520979584:12345-0@lo:501: 00000100:00100000:2.0:1783141731.323191:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520979584:12345-0@lo:501: Request processed in 86us (267us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141731.323200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141731.323383:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520979584:0@lo:501: 10000000:01000000:1.0:1783141731.323407:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783141731.323413:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141731.323422:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783141731.327131:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9f9c76002800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141731.327308:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759520978048:12345-0@lo:38: Request processed in 21805us (21922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.327321:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141731.329076:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141731.329103:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783141731.329113:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783141731.329119:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783141731.329122:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783141731.329151:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c01b7f99): req@ffff9f9c6ccc1c00 x1869759520978560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141731.329335:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520979712:0@lo:41: 00000100:00100000:3.0:1783141731.329338:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141731.329383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.329406:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141731.329432:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979712 00000100:00100000:2.0:1783141731.329432:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520978560 00000100:00100000:3.0:1783141731.329439:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979712 00000100:00100000:2.0:1783141731.329440:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520978560 00000100:00100000:3.0:1783141731.329603:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141731.329619:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759520979712:12345-0@lo:41: 00000004:00000024:3.0:1783141731.329652:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783141731.329697:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759520979712:12345-0@lo:41: Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141731.329703:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141731.329889:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520979712:0@lo:41: 00000100:00100000:2.0:1783141731.331669:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141731.331682:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520978560:12345-0@lo:1000: 00000100:00100000:2.0:1783141731.331805:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520978560:12345-0@lo:1000: Request processed in 125us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.331813:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783141731.331892:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520978560:0@lo:1000: 00000040:01000000:0.0:1783141731.331934:0:7932:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783141731.331979:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520979840:0@lo:1000: 00000100:00100000:0.0:1783141731.332034:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.332062:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.333588:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979840 00000100:00100000:2.0:1783141731.333600:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979840 00000100:00100000:2.0:1783141731.333649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141731.333660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520979840:12345-0@lo:1000: 00000100:00100000:2.0:1783141731.333821:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520979840:12345-0@lo:1000: Request processed in 163us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.333829:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141731.333848:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520979840:0@lo:1000: 00000100:00100000:0.0:1783141731.333902:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520979968:0@lo:700: 00000100:00100000:0.0:1783141731.333934:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.333962:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.334034:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520979968 00000100:00100000:2.0:1783141731.334039:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520979968 00000100:00100000:2.0:1783141731.334073:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141731.334080:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520979968:12345-0@lo:700: 00000100:00100000:2.0:1783141731.334120:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520979968:12345-0@lo:700: Request processed in 40us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.334126:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141731.334643:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759520978048:0@lo:38: 00000100:00100000:0.0:1783141731.334659:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520979968:0@lo:700: 00000100:00100000:0.0:1783141731.334770:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980096:0@lo:1000: 00000100:00100000:0.0:1783141731.334803:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141731.334862:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a970240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141731.337265:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980096 00000100:00100000:2.0:1783141731.337390:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980096 00000100:00100000:2.0:1783141731.337641:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141731.337651:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520980096:12345-0@lo:1000: 00000100:00100000:2.0:1783141731.337775:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520980096:12345-0@lo:1000: Request processed in 125us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141731.337782:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141731.337860:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980096:0@lo:1000: 00000004:00080000:1.0:1783141731.337924:0:7932:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9f9c760dfcc0 with version 0 00000020:00100000:1.0:1783141731.337946:0:7932:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783141731.337955:0:7932:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f9c4b3d5880 x1869759520980352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141731.337974:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980352:0@lo:1000: 00000100:00100000:1.0:1783141731.338023:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.338050:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b601a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.339725:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980352 00000100:00100000:0.0:1783141731.339737:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980352 00000100:00100000:0.0:1783141731.339799:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141731.339808:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7932:x1869759520980352:12345-0@lo:1000: 00000001:00080000:2.0:1783141731.353836:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1783141731.353849:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783141731.355352:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7932:x1869759520980352:12345-0@lo:1000: Request processed in 15537us (17320us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783141731.355366:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1783141731.355715:0:7932:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783141731.355720:0:7932:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783141731.355737:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980352:0@lo:1000: 00000100:00100000:3.0:1783141731.355824:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980480:0@lo:1000: 00000100:00100000:3.0:1783141731.355867:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141731.355923:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.356090:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980480 00000100:00100000:0.0:1783141731.356096:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980480 00000100:00100000:0.0:1783141731.356142:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141731.356151:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7932:x1869759520980480:12345-0@lo:1000: 00000100:00100000:0.0:1783141731.356839:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7932:x1869759520980480:12345-0@lo:1000: Request processed in 686us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141731.356848:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783141731.357040:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7932:1869759520980480:0@lo:1000: 00000040:00080000:3.0:1783141731.357061:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783141731.357093:0:7932:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9f9c4b601a80 with version 1 00000004:00080000:1.0:1783141731.357268:0:7930:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9f9c79b3d480 version 1 rpc_version 1 00000020:00100000:1.0:1783141731.357305:0:7930:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783141731.357313:0:7930:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9f9c4b3d5f80 x1869759520980736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141731.357331:0:7930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7930:1869759520980736:0@lo:1000: 00000100:00100000:1.0:1783141731.357363:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141731.357394:0:7930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141731.357512:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980736 00000100:00100000:0.0:1783141731.357517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980736 00000100:00100000:0.0:1783141731.357547:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141731.357554:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7930:x1869759520980736:12345-0@lo:1000: 00000001:00080000:0.0:1783141731.359838:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1783141731.359969:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7930:x1869759520980736:12345-0@lo:1000: Request processed in 2410us (2601us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783141731.359981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1783141731.360153:0:7930:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783141731.360160:0:7930:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783141731.360178:0:7930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7930:1869759520980736:0@lo:1000: 00000040:00080000:3.0:1783141731.364862:0:7932:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783141731.364936:0:7932:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783141731.364941:0:7932:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1783141732.228456:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141732.616436:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141732.616461:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520980864:0@lo:41: 00000100:00100000:3.0:1783141732.616547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141732.616576:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980864 00000100:00100000:0.0:1783141732.616592:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980864 00000100:00100000:0.0:1783141732.616650:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141732.616661:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520980864:12345-0@lo:41: 00000004:00000024:0.0:1783141732.616695:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1783141732.616751:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520980864:12345-0@lo:41: Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141732.616759:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783141732.616879:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520980864:0@lo:41: 00010000:00010000:2.0:1783141733.254718:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141734.279953:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141735.301029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141736.329209:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141736.744432:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520981248:0@lo:400: 00000100:00100000:3.0:1783141736.744526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141736.744584:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141736.744599:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520981376:0@lo:400: 00000100:00100000:3.0:1783141736.744638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141736.744677:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981248 00000100:00100000:3.0:1783141736.744684:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981248 00000100:00100000:3.0:1783141736.744729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141736.744738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520981248:12345-0@lo:400: 00000100:00100000:3.0:1783141736.744801:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520981248:12345-0@lo:400: Request processed in 64us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141736.744808:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141736.744829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981376 00000100:00100000:3.0:1783141736.744832:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981376 00000100:00100000:3.0:1783141736.744853:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783141736.744858:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520981376:12345-0@lo:400: 00000100:00100000:3.0:1783141736.744886:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520981376:12345-0@lo:400: Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141736.745346:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783141736.745385:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520981376:0@lo:400: 00010000:00080000:3.0:1783141736.745396:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c4b3d4380 x1869759520981248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141736.745406:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520981248:0@lo:400: 00000100:00100000:0.0:1783141736.746347:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520981120:0@lo:400: 00000100:00100000:2.0:1783141736.746363:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520980992:0@lo:41: 00000100:00100000:2.0:1783141736.746399:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.746399:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.746432:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520981632:0@lo:400: 00000100:00100000:0.0:1783141736.746453:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141736.746477:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520980992 00000100:00100000:0.0:1783141736.746478:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141736.746483:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520980992 00000100:00100000:0.0:1783141736.746484:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759520981504:0@lo:400: 00000100:00100000:3.0:1783141736.746508:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981632 00000100:00100000:3.0:1783141736.746511:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981632 00000100:00100000:0.0:1783141736.746523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141736.746524:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783141736.746530:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759520980992:12345-0@lo:41: 00000100:00100000:0.0:1783141736.746560:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000004:00000024:3.0:1783141736.746562:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783141736.746567:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759520981632:12345-0@lo:400: 00000100:00100000:3.0:1783141736.746602:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759520980992:12345-0@lo:41: Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.746602:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759520981632:12345-0@lo:400: Request processed in 37us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141736.746609:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141736.747372:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520980992:0@lo:41: 00000100:00100000:2.0:1783141736.747408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981504 00000100:00100000:2.0:1783141736.747412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981504 00000100:00100000:2.0:1783141736.747444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141736.747451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759520981504:12345-0@lo:400: 00000100:00100000:2.0:1783141736.747494:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759520981504:12345-0@lo:400: Request processed in 44us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141736.747508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783141736.752231:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141736.752294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981120 00000100:00100000:0.0:1783141736.752303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981120 00000100:00100000:0.0:1783141736.752351:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783141736.752360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:3655:x1869759520981120:12345-0@lo:400: 00000100:00100000:0.0:1783141736.752441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:3655:x1869759520981120:12345-0@lo:400: Request processed in 81us (6039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.752447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1783141736.752518:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c4b3d4000 x1869759520981504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141736.752532:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759520981504:0@lo:400: 00000100:00100000:0.0:1783141736.752543:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520981120:0@lo:400: 00000100:00100000:0.0:1783141736.752554:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520981632:0@lo:400: 00010000:00010000:2.0:1783141737.348691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141737.732759:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520981760:0@lo:41: 00000100:00100000:3.0:1783141737.732834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141737.732947:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981760 00000100:00100000:0.0:1783141737.732956:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981760 00000100:00100000:0.0:1783141737.733000:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141737.733009:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520981760:12345-0@lo:41: 00000004:00000024:0.0:1783141737.733044:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1783141737.735748:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520981760:12345-0@lo:41: Request processed in 2729us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141737.735763:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141737.736839:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520981760:0@lo:41: 00010000:00010000:3.0:1783141738.372449:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141739.396489:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141740.421487:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783141740.638951:0:8431:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783141740.638955:0:8431:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783141740.638957:0:8431:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783141740.639082:0:8431:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9c7b728800 00000020:01000004:2.0:1783141740.639096:0:8431:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783141740.639107:0:8431:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783141740.639120:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f9c7b664d40) 00000020:00000080:2.0:1783141740.639135:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783141740.700507:0:8431:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783141740.700792:0:8431:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1783141740.740493:0:8431:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783141740.740727:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783141740.740739:0:8431:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783141740.740750:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb31399d6a3806b1e 00000020:01000004:2.0:1783141740.740757:0:8431:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783141740.740777:0:8431:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783141740.740781:0:8431:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783141740.740786:0:8431:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783141740.740791:0:8431:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783141740.740802:0:8431:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f9c7b660000) 00000020:00000080:2.0:1783141740.740812:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1783141740.743813:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141740.743975:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783141740.743981:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783141740.747100:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783141740.747114:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783141740.750481:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141740.750492:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783141740.752710:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141740.752889:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783141740.752895:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783141740.753890:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783141740.753900:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783141740.773261:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141740.773498:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141740.773506:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783141740.775377:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783141740.775390:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783141740.776843:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783141740.776855:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783141740.779052:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141740.779243:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783141740.779250:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783141740.780066:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783141740.780073:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783141740.877806:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141740.877985:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783141740.877991:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783141740.879156:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783141740.879173:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783141740.880798:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783141740.880830:0:8431:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1783141740.880836:0:8431:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783141740.933102:0:8431:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783141740.933138:0:8431:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1783141740.933143:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783141740.933145:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141740.933147:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141740.933148:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141740.933149:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141740.933151:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141740.933152:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141740.933154:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141740.933155:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141740.933172:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141740.933173:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783141740.933177:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1783141740.933179:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783141740.933180:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141740.933181:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141740.933182:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141740.933189:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141740.933190:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141740.933191:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141740.933192:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141740.933193:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141740.933194:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141740.933194:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783141740.933222:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783141740.933239:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520981888:0@lo:253: 00000100:00100000:0.0:1783141740.933343:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141740.937847:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141740.938118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520981888 00000100:00100000:2.0:1783141740.938128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520981888 00000100:00100000:2.0:1783141740.938195:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783141740.938205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:8431:x1869759520981888:12345-0@lo:253: 20000000:01000000:2.0:1783141740.938260:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783141740.938264:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783141740.938289:0:6517:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783141740.938292:0:6517:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783141740.938911:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141740.939097:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783141740.939111:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783141740.939128:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783141740.939133:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783141740.939145:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783141740.939171:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783141740.939260:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783141740.939807:0:6517:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141740.939810:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141740.939835:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783141740.939850:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783141740.939865:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783141740.939870:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141740.939881:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783141740.939887:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783141740.939899:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783141740.939914:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783141740.939994:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1783141740.940006:0:6517:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141740.940008:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141740.940020:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1783141740.940025:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783141740.940036:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1783141740.940040:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141740.940051:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1783141740.940055:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783141740.940066:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1783141740.940081:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1783141740.942192:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1783141740.942221:0:6517:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141740.942224:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141740.942242:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1783141740.942250:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783141740.942262:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1783141740.942267:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141740.942310:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1783141740.942319:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783141740.942333:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1783141740.942348:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1783141740.942360:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783141740.942376:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783141740.942380:0:6517:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783141740.942451:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783141740.942454:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141740.945034:0:8450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141740.945080:0:8450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141740.945096:0:8450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783141740.945863:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1783141740.945886:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1783141740.945900:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1783141740.945908:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783141740.945911:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783141740.955541:0:8451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783141740.955921:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783141740.955964:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783141740.955982:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783141740.955992:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783141740.955994:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141740.957775:0:8452:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141740.957821:0:8452:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141740.957841:0:8452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1783141740.958104:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1783141740.958127:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1783141740.958145:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1783141740.958166:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783141740.958169:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141740.960037:0:8453:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141740.960085:0:8453:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141740.960104:0:8453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783141740.960342:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783141740.960367:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783141740.960383:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1783141740.960402:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783141740.960420:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960437:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960445:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960453:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960474:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960481:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960489:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960527:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960556:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 18 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.960571:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982016:0@lo:104: 00000100:00100000:2.0:1783141740.960646:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141740.960702:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960710:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 18 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.960848:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982144:0@lo:104: 00000100:00100000:2.0:1783141740.960876:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141740.960902:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960912:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 18 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.960928:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982272:0@lo:104: 00000100:00100000:2.0:1783141740.960951:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141740.960968:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.960977:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 18 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.960985:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982400:0@lo:104: 00000100:00100000:2.0:1783141740.961005:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141740.961022:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.961030:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 18 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.961038:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982528:0@lo:104: 00000100:00100000:2.0:1783141740.961072:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.961084:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141740.961253:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982016 00000100:00100000:1.0:1783141740.961260:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982016 00000100:00100000:1.0:1783141740.961309:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982144 00000100:00100000:1.0:1783141740.961312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982144 00000100:00100000:1.0:1783141740.961321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982272 00000100:00100000:1.0:1783141740.961323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982272 00000100:00100000:1.0:1783141740.961332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982400 00000100:00100000:1.0:1783141740.961334:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982400 00000100:00100000:1.0:1783141740.961342:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982528 00000100:00100000:1.0:1783141740.961344:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982528 00000100:00100000:1.0:1783141740.961356:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141740.961363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:6517:x1869759520982016:12345-0@lo:104: 00010000:00010000:1.0:1783141740.961374:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.961437:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141740.961442:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:6517:x1869759520982016:12345-0@lo:104: Request processed in 81us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.961450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141740.961467:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141740.961473:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6517:x1869759520982144:12345-0@lo:104: 00010000:00010000:1.0:1783141740.961480:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.961512:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783141740.961517:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:6517:x1869759520982144:12345-0@lo:104: Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.961523:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141740.961534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141740.961539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6517:x1869759520982272:12345-0@lo:104: 00000100:00100000:2.0:1783141740.961712:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982016:0@lo:104: 00000100:00100000:2.0:1783141740.961867:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982144:0@lo:104: 00010000:00010000:1.0:1783141740.961921:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.961958:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783141740.961964:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6517:x1869759520982272:12345-0@lo:104: Request processed in 425us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.961970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141740.961984:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141740.961990:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6517:x1869759520982400:12345-0@lo:104: 00010000:00010000:1.0:1783141740.961997:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962022:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783141740.962026:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6517:x1869759520982400:12345-0@lo:104: Request processed in 38us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.962032:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141740.962045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141740.962051:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6517:x1869759520982528:12345-0@lo:104: 00010000:00010000:1.0:1783141740.962058:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962084:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783141740.962088:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6517:x1869759520982528:12345-0@lo:104: Request processed in 39us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.962093:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783141740.962110:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783141740.962116:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962128:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2e00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.962132:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962141:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.962148:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.962154:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.962197:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962204:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.962222:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962229:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2e00/0xb31399d6a3806b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962242:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783141740.962245:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962251:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fe00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.962254:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962289:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.962296:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.962301:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.962315:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962320:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.962334:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962341:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ad8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962350:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783141740.962353:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962359:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.962362:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962368:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.962375:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.962386:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.962401:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962406:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.962411:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962418:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806abc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962427:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141740.962430:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962435:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.962438:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962445:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.962450:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.962455:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.962467:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962473:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.962484:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806a6f expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962499:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141740.962503:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962522:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.962525:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962532:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.962538:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.962551:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.962562:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962568:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.962572:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962578:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a38069f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38069f8 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.962590:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141740.962597:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141740.962599:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141740.962715:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520982656:0@lo:103: 00000100:00100000:2.0:1783141740.962895:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.962935:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520983168:0@lo:103: 00000100:00100000:2.0:1783141740.962969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.962991:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141740.963005:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520983040:0@lo:103: 00000100:00100000:2.0:1783141740.963027:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.963054:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520982784:0@lo:103: 00000100:00100000:2.0:1783141740.963073:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.963083:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141740.963088:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520982912:0@lo:103: 00000100:00100000:2.0:1783141740.963106:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141740.963125:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982656 00000100:00100000:2.0:1783141740.963132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982656 00010000:00010000:2.0:1783141740.963168:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 19 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.963187:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983168 00000100:00100000:2.0:1783141740.963190:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983168 00010000:00010000:2.0:1783141740.963201:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 20 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.963211:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983040 00000100:00100000:2.0:1783141740.963213:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983040 00010000:00010000:2.0:1783141740.963222:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 21 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.963231:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982784 00000100:00100000:2.0:1783141740.963233:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982784 00010000:00010000:2.0:1783141740.963241:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 22 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.963250:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520982912 00000100:00100000:2.0:1783141740.963252:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520982912 00010000:00010000:2.0:1783141740.963260:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 23 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141740.963313:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141740.963321:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3653:x1869759520982656:12345-0@lo:103: 00010000:00010000:2.0:1783141740.963333:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141740.963338:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 23 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963349:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 23 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963364:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168ee00/0xb31399d6a3806b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806b09 expref: 23 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963376:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141740.963408:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3653:x1869759520982656:12345-0@lo:103: Request processed in 87us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.963414:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141740.963428:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141740.963434:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3653:x1869759520983168:12345-0@lo:103: 00010000:00010000:2.0:1783141740.963441:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141740.963445:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 21 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963453:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 21 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963463:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141740.963483:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41aff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3653:x1869759520983168:12345-0@lo:103: Request processed in 49us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.963496:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141740.963509:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141740.963514:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3653:x1869759520983040:12345-0@lo:103: 00010000:00010000:2.0:1783141740.963521:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141740.963525:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 20 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963534:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 20 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.963555:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141740.963577:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3653:x1869759520983040:12345-0@lo:103: Request processed in 63us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.963583:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141740.963593:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141740.963598:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:3654:x1869759520982784:12345-0@lo:103: 00010000:00010000:2.0:1783141740.964346:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141740.964355:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 19 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964366:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 19 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964378:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806ad1 expref: 19 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964388:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141740.964430:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:3654:x1869759520982784:12345-0@lo:103: Request processed in 831us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.964444:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141740.964460:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141740.964467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:3654:x1869759520982912:12345-0@lo:103: 00010000:00010000:2.0:1783141740.964486:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141740.964491:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 17 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964500:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 17 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964519:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964527:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964551:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964559:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964565:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964572:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964578:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141740.964582:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.964596:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.964695:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141740.964987:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520982784:0@lo:103: 00010000:00010000:3.0:1783141740.965080:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a2000/0xb31399d6a3806abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806ab5 expref: 17 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141740.965093:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982272:0@lo:104: 00010000:00010000:3.0:1783141740.965103:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806a68 expref: 16 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141740.965110:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982400:0@lo:104: 00010000:00010000:3.0:1783141740.965119:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168f600/0xb31399d6a38069f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38069f1 expref: 15 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141740.965139:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869759520982528:0@lo:104: 00010000:00010000:3.0:1783141740.965173:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141740.965183:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141740.965189:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783141740.965196:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1783141740.965419:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.965429:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.965442:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141740.965484:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520982912:12345-0@lo:103: Request processed in 1017us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.965492:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141740.965569:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520983040:0@lo:103: 00000100:00100000:2.0:1783141740.965577:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520982656:0@lo:103: 00000100:00100000:2.0:1783141740.965585:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520983168:0@lo:103: 00000100:00100000:0.0:1783141740.965714:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520982912:0@lo:103: 00000100:00100000:3.0:1783141740.968147:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:8431:x1869759520981888:12345-0@lo:253: Request processed in 29933us (34795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141740.968172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783141740.968264:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520981888:0@lo:253: 10000000:01000000:0.0:1783141740.968319:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783141740.968322:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141740.968324:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141740.968325:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141740.968326:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1783141740.968327:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141740.968328:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141740.968330:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141740.968331:0:8431:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783141740.968343:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141740.968344:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783141740.968363:0:8431:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c7b728800 from lustre-OST0000 10000000:01000000:0.0:1783141740.968392:0:8431:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783141740.968395:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783141740.968404:0:8431:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9c48c28000 local copy 10000000:01000000:0.0:1783141740.968408:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783141740.968442:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.968453:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.968462:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141740.968491:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983296:0@lo:101: 00000100:00100000:0.0:1783141740.968537:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141740.968827:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141740.968946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983296 00000100:00100000:1.0:1783141740.968952:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983296 00000100:00100000:1.0:1783141740.968999:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783141740.969008:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:8431:x1869759520983296:12345-0@lo:101: 00010000:00010000:1.0:1783141740.969021:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141740.969034:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806b33 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.969055:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806b33 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.969064:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b33 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.969072:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e800, rc 0) 00000100:00100000:1.0:1783141740.969110:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983296:12345-0@lo:101: Request processed in 104us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.969117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141740.969217:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983296:0@lo:101: 00010000:00010000:0.0:1783141740.969229:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.969238:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141740.969355:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983424:0@lo:501: 00000100:00100000:0.0:1783141740.969382:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141740.969401:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141740.969449:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983424 00000100:00100000:3.0:1783141740.969454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983424 00000100:00100000:3.0:1783141740.969491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783141740.969498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983424:12345-0@lo:501: 00000100:00100000:3.0:1783141740.969582:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983424:12345-0@lo:501: Request processed in 85us (199us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141740.969589:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141740.969924:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983424:0@lo:501: 10000000:01000000:0.0:1783141740.969950:0:8431:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783141740.969968:0:8431:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783141740.969973:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.969981:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.969988:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.970012:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783141740.970034:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c7b728800 10000000:01000000:0.0:1783141740.970039:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783141740.970044:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783141740.970047:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141740.970051:0:8431:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783141740.970054:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141740.970069:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.970077:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.970085:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141740.970097:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983552:0@lo:101: 00000100:00100000:0.0:1783141740.970121:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141740.970231:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738b40 going to sleep for 11 seconds 00010000:00010000:1.0:1783141740.970265:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141740.970329:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970337:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031e00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141740.970341:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970349:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141740.970362:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141740.970367:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141740.970384:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970390:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141740.970411:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970418:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806b3a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141740.970430:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141740.970432:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141740.970488:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141740.970499:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520983680:0@lo:103: 00000100:00100000:3.0:1783141740.970536:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141740.970615:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983680 00000100:00100000:1.0:1783141740.970620:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983680 00000100:00100000:1.0:1783141740.970657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141740.970664:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3655:x1869759520983680:12345-0@lo:103: 00010000:00010000:1.0:1783141740.970674:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141740.970685:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806b33 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.970698:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141740.970727:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:3655:x1869759520983680:12345-0@lo:103: Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.970733:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141740.970766:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520983680:0@lo:103: 00000100:00100000:2.0:1783141740.974699:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983552 00000100:00100000:2.0:1783141740.974714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983552 00000100:00100000:2.0:1783141740.974824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783141740.974834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+13:8431:x1869759520983552:12345-0@lo:101: 00010000:00010000:2.0:1783141740.974851:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141740.974868:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806b41 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.974893:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.974922:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141740.974930:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3000, rc 0) 00000100:00100000:2.0:1783141740.975016:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983552:12345-0@lo:101: Request processed in 184us (4893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.975022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783141740.975195:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983552:0@lo:101: 00010000:00010000:1.0:1783141740.975213:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141740.975222:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141740.975339:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983808:0@lo:501: 00000100:00100000:1.0:1783141740.975373:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141740.980995:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c60ea1900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141740.981133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983808 00000100:00100000:3.0:1783141740.981143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983808 00000100:00100000:3.0:1783141740.981202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783141740.981222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983808:12345-0@lo:501: 00000100:00100000:3.0:1783141740.981418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983808:12345-0@lo:501: Request processed in 198us (6043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141740.981427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783141740.981895:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983808:0@lo:501: 00000100:00100000:1.0:1783141740.981943:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983936:0@lo:503: 00000100:00100000:1.0:1783141740.981993:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141740.982060:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c60ea1900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141740.982094:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520983936 00000100:00100000:3.0:1783141740.982098:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520983936 00000100:00100000:3.0:1783141740.982168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783141740.982176:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983936:12345-0@lo:503: 00000100:00100000:3.0:1783141740.982326:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520983936:12345-0@lo:503: Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141740.982333:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783141740.982733:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520983936:0@lo:503: 00000040:00080000:1.0:1783141740.982978:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141740.983049:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984064:0@lo:502: 00000100:00100000:1.0:1783141740.983091:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141740.983129:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141740.983192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984064 00000100:00100000:2.0:1783141740.983199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984064 00000100:00100000:2.0:1783141740.983266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783141740.983303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520984064:12345-0@lo:502: 00000100:00100000:2.0:1783141740.983392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520984064:12345-0@lo:502: Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.983399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783141740.983793:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984064:0@lo:502: 00000040:00080000:1.0:1783141740.983993:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783141740.984022:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783141740.984036:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783141740.984048:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783141740.984061:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783141740.984081:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783141740.984102:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984192:0@lo:502: 00000100:00100000:1.0:1783141740.984141:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141740.984182:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c60ea1900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141740.984230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984192 00000100:00100000:2.0:1783141740.984234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984192 00000100:00100000:2.0:1783141740.984266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783141740.984294:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520984192:12345-0@lo:502: 00000100:00100000:2.0:1783141740.984366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520984192:12345-0@lo:502: Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.984373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141740.984461:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984192:0@lo:502: 00000040:00080000:1.0:1783141740.984734:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783141740.984742:0:8431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1783141740.985265:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783141740.985391:0:8454:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783141740.985398:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141740.985400:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783141740.985406:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141740.985427:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f9b41b1b380) 00000020:00000080:2.0:1783141740.985450:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783141740.985457:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783141740.985762:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c7b728800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783141740.985771:0:8454:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783141740.985777:0:8454:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb31399d6a3806b56 00010000:00010000:2.0:1783141740.991882:0:8454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1783141740.992144:0:8454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1783141740.995856:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783141740.996223:0:8454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783141741.001426:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1783141741.001853:0:8454:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783141741.009100:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783141741.011117:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783141741.011129:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141741.011136:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141741.011139:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783141741.011142:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141741.011147:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141741.011148:0:8454:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141741.011152:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141741.011154:0:8454:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783141741.011197:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141741.011200:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141741.011202:0:8454:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141741.011205:0:8454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783141741.013897:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1783141741.013942:0:8431:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783141741.013967:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.013979:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141741.014047:0:8431:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b728800 from 1 10000000:01000000:3.0:1783141741.014058:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141741.014097:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.014106:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.014116:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.014138:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984320:0@lo:101: 00000100:00100000:3.0:1783141741.014220:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.014293:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.014360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984320 00000100:00100000:2.0:1783141741.014368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984320 00000100:00100000:2.0:1783141741.014420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783141741.014429:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:8431:x1869759520984320:12345-0@lo:101: 00010000:00010000:2.0:1783141741.014442:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141741.014454:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806b5d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.014759:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.014774:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.014783:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:2.0:1783141741.014833:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984320:12345-0@lo:101: Request processed in 404us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.014849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783141741.014941:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984320:0@lo:101: 00010000:00010000:3.0:1783141741.014956:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.014965:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.015055:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984448:0@lo:501: 00000100:00100000:3.0:1783141741.015081:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.015103:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.015167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984448 00000100:00100000:2.0:1783141741.015172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984448 00000100:00100000:2.0:1783141741.015202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141741.015208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984448:12345-0@lo:501: 00000100:00100000:2.0:1783141741.015315:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984448:12345-0@lo:501: Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.015321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783141741.015397:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984448:0@lo:501: 00000100:00100000:3.0:1783141741.015420:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984576:0@lo:503: 00000100:00100000:3.0:1783141741.015455:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.015490:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.015757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984576 00000100:00100000:2.0:1783141741.015762:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984576 00000100:00100000:2.0:1783141741.015791:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783141741.015798:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984576:12345-0@lo:503: 00000100:00100000:2.0:1783141741.015880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984576:12345-0@lo:503: Request processed in 81us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.015886:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783141741.016029:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984576:0@lo:503: 00000040:00080000:3.0:1783141741.016253:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141741.016425:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984704:0@lo:502: 00000100:00100000:3.0:1783141741.016462:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.016496:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.016559:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984704 00000100:00100000:2.0:1783141741.016564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984704 00000100:00100000:2.0:1783141741.016590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783141741.016597:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984704:12345-0@lo:502: 00000100:00100000:2.0:1783141741.016687:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984704:12345-0@lo:502: Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.016694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141741.016822:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984704:0@lo:502: 00000040:00080000:3.0:1783141741.016997:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783141741.017024:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783141741.017044:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984832:0@lo:502: 00000100:00100000:3.0:1783141741.017076:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.017099:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.017900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984832 00000100:00100000:1.0:1783141741.017909:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984832 00000100:00100000:1.0:1783141741.017960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783141741.017968:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984832:12345-0@lo:502: 00000100:00100000:1.0:1783141741.018105:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984832:12345-0@lo:502: Request processed in 137us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.018113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783141741.018173:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984832:0@lo:502: 00000040:00080000:3.0:1783141741.018236:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783141741.018249:0:8431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783141741.019055:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141741.019066:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141741.019068:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783141741.019074:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c7b728800 00000020:00000080:2.0:1783141741.019076:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783141741.019097:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141741.019100:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141741.019101:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783141741.019103:0:8458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783141741.019248:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783141741.019376:0:8431:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141741.019433:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.019445:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141741.019731:0:8431:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783141741.019735:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c7b728800 10000000:01000000:3.0:1783141741.019738:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c7b728800 10000000:01000000:3.0:1783141741.019742:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141741.019747:0:8431:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b728800 from 1 10000000:01000000:3.0:1783141741.019750:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141741.019783:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.019799:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.019811:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.019830:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984960:0@lo:101: 00000100:00100000:3.0:1783141741.019884:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.019962:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084780 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.020023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520984960 00000100:00100000:2.0:1783141741.020029:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520984960 00000100:00100000:2.0:1783141741.020099:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783141741.020108:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8431:x1869759520984960:12345-0@lo:101: 00010000:00010000:2.0:1783141741.020121:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141741.020131:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806b6b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.020152:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.020176:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.020185:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3600, rc 0) 00000100:00100000:2.0:1783141741.020229:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520984960:12345-0@lo:101: Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.020236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783141741.020310:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520984960:0@lo:101: 00010000:00010000:3.0:1783141741.020324:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.020333:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.020402:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985088:0@lo:501: 00000100:00100000:3.0:1783141741.020427:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.020551:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141741.022420:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985088 00000100:00100000:0.0:1783141741.022434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985088 00000100:00100000:0.0:1783141741.022498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141741.022518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985088:12345-0@lo:501: 00000100:00100000:0.0:1783141741.022878:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985088:12345-0@lo:501: Request processed in 371us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.022887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783141741.024204:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985088:0@lo:501: 00000100:00100000:1.0:1783141741.024404:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985216:0@lo:503: 00000100:00100000:1.0:1783141741.024480:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.024525:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.025122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985216 00000100:00100000:3.0:1783141741.025130:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985216 00000100:00100000:3.0:1783141741.025178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783141741.025188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985216:12345-0@lo:503: 00000100:00100000:3.0:1783141741.025341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985216:12345-0@lo:503: Request processed in 154us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.025349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783141741.025426:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985216:0@lo:503: 00000040:00080000:1.0:1783141741.025661:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141741.025904:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985344:0@lo:502: 00000100:00100000:1.0:1783141741.026005:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.026098:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.026449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985344 00000100:00100000:3.0:1783141741.026456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985344 00000100:00100000:3.0:1783141741.026497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783141741.026505:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985344:12345-0@lo:502: 00000100:00100000:3.0:1783141741.026640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985344:12345-0@lo:502: Request processed in 136us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.026648:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783141741.026696:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985344:0@lo:502: 00000040:00080000:3.0:1783141741.026896:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783141741.026923:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783141741.026935:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783141741.026946:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783141741.026958:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783141741.026969:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783141741.026979:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783141741.026990:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783141741.027001:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783141741.027012:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783141741.027038:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783141741.027067:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783141741.027080:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783141741.027093:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783141741.027105:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783141741.027118:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783141741.027130:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783141741.027142:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783141741.027152:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783141741.027178:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783141741.027191:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783141741.027205:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783141741.027217:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783141741.027243:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783141741.027257:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783141741.027268:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783141741.027306:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783141741.027328:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783141741.027341:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783141741.027353:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783141741.027366:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783141741.027379:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783141741.027391:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783141741.027402:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783141741.027413:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783141741.027426:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783141741.027439:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1783141741.027466:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985472:0@lo:502: 00000100:00100000:3.0:1783141741.027509:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.027540:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985472 00000100:00100000:3.0:1783141741.027545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985472 00000100:00100000:3.0:1783141741.027568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783141741.027575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985472:12345-0@lo:502: 00000100:00100000:3.0:1783141741.027646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520985472:12345-0@lo:502: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.027652:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783141741.027695:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.027711:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520985472:0@lo:502: 00000040:00080000:3.0:1783141741.027748:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783141741.027755:0:8431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1783141741.028025:0:8459:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783141741.028039:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f9c6ccd99c0) 00000020:00000080:3.0:1783141741.028058:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1783141741.029900:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c7b728800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141741.029910:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c7b728800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141741.029912:0:8459:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b728800 3 00010000:00080000:3.0:1783141741.029947:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c760a2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783141741.041338:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1783141741.041444:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783141741.041498:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783141741.041521:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb31399d6a3806b80 00000100:00080000:3.0:1783141741.041531:0:8459:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141741.041537:0:8459:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f9c760a2800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783141741.042123:0:8459:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6cccbb80 x1869759520985600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141741.042191:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759520985600:0@lo:38: 00000100:00100000:1.0:1783141741.042264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141741.042384:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985600 00000100:00100000:2.0:1783141741.042392:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985600 00000100:00100000:2.0:1783141741.042423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141741.042431:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759520985600:12345-0@lo:38: 00010000:00080000:2.0:1783141741.042454:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1783141741.042494:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb31399d6a3806b87 00000004:00100000:2.0:1783141741.042516:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783141741.042551:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f9b41b10000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783141741.042723:0:8459:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783141741.043269:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520985728:0@lo:400: 00000100:00100000:3.0:1783141741.043329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.043403:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141741.043410:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520986112:0@lo:400: 00000100:00100000:3.0:1783141741.043436:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.043465:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986112 00000100:00100000:3.0:1783141741.043470:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986112 00000100:00100000:3.0:1783141741.043524:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141741.043532:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759520986112:12345-0@lo:400: 00000100:00100000:3.0:1783141741.043730:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759520986112:12345-0@lo:400: Request processed in 198us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.043739:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141741.043786:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520986112:0@lo:400: 00000020:01000004:3.0:1783141741.043883:0:8459:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783141741.043916:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f9b42300000) 00000020:00000080:3.0:1783141741.043936:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1783141741.044099:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c7b728800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141741.044104:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c7b728800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141741.044106:0:8459:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b728800 3 00010000:00080000:3.0:1783141741.044138:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c760a1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.139@tcp at head 00000100:00100000:0.0:1783141741.047218:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985728 00000100:00100000:0.0:1783141741.047235:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985728 00000100:00100000:0.0:1783141741.047312:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783141741.047322:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520985728:12345-0@lo:400: 00000100:00100000:0.0:1783141741.047462:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520985728:12345-0@lo:400: Request processed in 140us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.047469:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783141741.047854:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6ccc0700 x1869759520985728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141741.047870:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520985728:0@lo:400: 00010000:00010000:3.0:1783141741.048242:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1783141741.048421:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783141741.048458:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783141741.048469:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb31399d6a3806b95 00000100:00100000:2.0:1783141741.048726:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759520985600:12345-0@lo:38: Request processed in 6292us (6460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.048736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141741.048773:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759520985984:0@lo:400: 00000100:00100000:2.0:1783141741.048820:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141741.048892:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141741.048900:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520985856:0@lo:400: 00000100:00100000:2.0:1783141741.048929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141741.048980:0:8459:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141741.048987:0:8459:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f9c760a1000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783141741.049017:0:8459:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6ccc9180 x1869759520986240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783141741.049032:0:8459:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:1.0:1783141741.049305:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6cccbb80 x1869759520985600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141741.049321:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141741.049330:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783141741.049337:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783141741.049341:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783141741.049344:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783141741.049352:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759520985600:0@lo:38: 00000100:00100000:1.0:1783141741.049371:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759520986240:0@lo:38: 00000100:00100000:1.0:1783141741.049402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141741.051794:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985984 00000100:00100000:0.0:1783141741.051807:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985984 00000100:00100000:0.0:1783141741.051851:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986240 00000100:00100000:0.0:1783141741.051854:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986240 00000100:00100000:0.0:1783141741.051870:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783141741.051879:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759520985984:12345-0@lo:400: 00000100:00100000:0.0:1783141741.052013:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759520985984:12345-0@lo:400: Request processed in 82us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.052021:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783141741.052038:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141741.052043:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759520986240:12345-0@lo:38: 00010000:00080000:0.0:1783141741.052067:0:7934:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1783141741.052101:0:7934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb31399d6a3806b9c 00000004:00100000:0.0:1783141741.052126:0:7934:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783141741.052170:0:7934:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141741.052218:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759520986240:12345-0@lo:38: Request processed in 174us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.052226:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783141741.052427:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6ccc9180 x1869759520986240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141741.052438:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141741.052445:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783141741.052452:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783141741.052457:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783141741.052459:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783141741.052464:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759520986240:0@lo:38: 00000100:00100000:2.0:1783141741.052901:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520985856 00000100:00100000:2.0:1783141741.052908:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520985856 00000100:00100000:2.0:1783141741.052946:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141741.052953:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520985856:12345-0@lo:400: 00000100:00100000:2.0:1783141741.053012:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520985856:12345-0@lo:400: Request processed in 59us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.053019:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141741.053053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520985856:0@lo:400: 00010000:00080000:2.0:1783141741.053066:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c6ccc3100 x1869759520985984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141741.053076:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759520985984:0@lo:400: 00000040:00080000:1.0:1783141741.054805:0:8459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783141741.058871:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783141741.058912:0:8431:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141741.058933:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.058946:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783141741.059000:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783141741.059003:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783141741.059010:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141741.059011:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141741.059012:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141741.059014:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141741.059015:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141741.059016:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141741.059017:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141741.059019:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141741.059020:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141741.059024:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1783141741.059026:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141741.059027:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783141741.059028:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141741.059029:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141741.059030:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141741.059031:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141741.059032:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141741.059033:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141741.059034:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141741.059035:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141741.059036:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141741.059062:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783141741.059080:0:8431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520986368:0@lo:253: 00000100:00100000:3.0:1783141741.059148:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.059208:0:8431:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.059339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986368 00000100:00100000:1.0:1783141741.059347:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986368 00000100:00100000:1.0:1783141741.059391:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783141741.059400:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520986368:12345-0@lo:253: 20000000:01000000:1.0:1783141741.059428:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783141741.059441:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783141741.066935:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783141741.066954:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783141741.066990:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783141741.066997:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783141741.067018:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.067046:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.067054:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.067060:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.067104:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.067128:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.067143:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520986496:0@lo:104: 00000100:00100000:1.0:1783141741.068521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:8431:x1869759520986368:12345-0@lo:253: Request processed in 9109us (9359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.068534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783141741.068770:0:8431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8431:1869759520986368:0@lo:253: 10000000:01000000:2.0:1783141741.068784:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783141741.068788:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783141741.068790:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141741.068791:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141741.068792:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141741.068793:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141741.068794:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141741.068796:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141741.068805:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141741.068806:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141741.068808:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141741.068809:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783141741.068823:0:8431:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783141741.074316:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783141741.074683:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783141741.074953:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783141741.075181:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783141741.075460:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783141741.076151:0:8431:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1783141741.076692:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141741.076881:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.076896:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.076910:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520986624:0@lo:104: 00000100:00100000:3.0:1783141741.077386:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.077416:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783141741.077438:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.077459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986496 00000100:00100000:0.0:1783141741.077460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986624 00000100:00100000:3.0:1783141741.077467:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986496 00000100:00100000:0.0:1783141741.077467:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986624 00000100:00100000:0.0:1783141741.077515:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141741.077524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759520986496:12345-0@lo:104: 00010000:00010000:0.0:1783141741.077538:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.077861:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141741.077868:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759520986496:12345-0@lo:104: Request processed in 345us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.077875:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141741.077910:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141741.077917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520986624:12345-0@lo:104: 00010000:00010000:0.0:1783141741.077925:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.077958:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141741.077963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759520986624:12345-0@lo:104: Request processed in 48us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.077970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783141741.078045:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520986496:0@lo:104: 00000100:00100000:2.0:1783141741.078053:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759520986624:0@lo:104: 00010000:00010000:2.0:1783141741.078072:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078707:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141741.078715:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078736:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3800 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141741.078740:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078749:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141741.078756:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141741.078762:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141741.078803:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078809:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141741.078835:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.078844:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520986752:0@lo:103: 00010000:00010000:0.0:1783141741.078845:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078864:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141741.078868:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078874:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141741.078877:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078894:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.078899:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1783141741.078907:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141741.078913:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141741.078929:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078935:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141741.078951:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078957:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aa0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.078973:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141741.078975:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141741.078977:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141741.079035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986752 00000100:00100000:2.0:1783141741.079041:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986752 00010000:00010000:2.0:1783141741.079063:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141741.079301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141741.079309:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3655:x1869759520986752:12345-0@lo:103: 00010000:00010000:2.0:1783141741.079330:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141741.079335:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.079347:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.079369:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a2a00/0xb31399d6a3806aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806ac3 expref: 16 pid: 6517 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.079382:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141741.079420:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3655:x1869759520986752:12345-0@lo:103: Request processed in 112us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.079428:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141741.079446:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141741.079454:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520986880:0@lo:103: 00000100:00100000:2.0:1783141741.080261:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141741.080349:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520986752:0@lo:103: 00000100:00100000:0.0:1783141741.080414:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520986880 00000100:00100000:0.0:1783141741.080421:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520986880 00010000:00010000:0.0:1783141741.080444:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141741.080710:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141741.080719:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3653:x1869759520986880:12345-0@lo:103: 00010000:00010000:0.0:1783141741.080730:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141741.080735:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080755:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080770:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3806aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806a99 expref: 15 pid: 6516 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080783:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080791:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783141741.080804:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018884896s 00010000:00010000:0.0:1783141741.080808:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080815:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080821:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080828:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080834:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141741.080838:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080846:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080865:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.080874:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141741.080911:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3653:x1869759520986880:12345-0@lo:103: Request processed in 194us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.080918:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783141741.081319:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520986880:0@lo:103: 00010000:00010000:2.0:1783141741.081346:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.081353:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.081359:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806ba3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783141741.081833:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1783141741.082315:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783141741.101327:0:8431:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783141741.101337:0:8431:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783141741.101368:0:8431:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783141741.101413:0:8431:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783141741.101433:0:8431:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783141741.101483:0:8431:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783141741.102320:0:8431:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141741.102497:0:8431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783141741.454875:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141741.833556:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520987008:0@lo:41: 00000100:00100000:2.0:1783141741.833620:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.833769:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987008 00000100:00100000:1.0:1783141741.833788:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987008 00000100:00100000:1.0:1783141741.833838:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141741.833847:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520987008:12345-0@lo:41: 00000004:00000024:1.0:1783141741.833880:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783141741.836949:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520987008:12345-0@lo:41: Request processed in 3095us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.836966:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141741.836975:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520987008:0@lo:41: 00000020:00000004:0.0:1783141742.085729:0:8515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141742.085946:0:8515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783141742.468961:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141742.859482:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141742.859515:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520987136:0@lo:41: 00000100:00100000:1.0:1783141742.859578:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141742.859652:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987136 00000100:00100000:1.0:1783141742.859658:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987136 00000100:00100000:1.0:1783141742.859699:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141742.859706:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520987136:12345-0@lo:41: 00000004:00000024:1.0:1783141742.859740:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1783141742.859786:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520987136:12345-0@lo:41: Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141742.859792:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141742.859836:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520987136:0@lo:41: 00010000:00010000:0.0:1783141743.496174:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141744.520470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141745.541750:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141746.443687:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520987648:0@lo:400: 00000100:00100000:2.0:1783141746.443762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.443825:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783141746.443832:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520987264:0@lo:400: 00000100:00100000:2.0:1783141746.443860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.443884:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520987776:0@lo:400: 00000100:00100000:2.0:1783141746.443908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.443933:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520987520:0@lo:400: 00000100:00100000:2.0:1783141746.443955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.443971:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759520988032:0@lo:400: 00000100:00100000:2.0:1783141746.443995:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.444059:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141746.444066:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759520987392:0@lo:400: 00000100:00100000:2.0:1783141746.444148:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.444167:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759520987904:0@lo:400: 00000100:00100000:2.0:1783141746.444193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.444220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987264 00000100:00100000:2.0:1783141746.444227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987264 00000100:00100000:2.0:1783141746.444302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141746.444311:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520987264:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3654:x1869759520987264:12345-0@lo:400: Request processed in 48us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444381:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141746.444410:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987776 00000100:00100000:2.0:1783141746.444414:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987776 00000100:00100000:2.0:1783141746.444433:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987520 00000100:00100000:2.0:1783141746.444435:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987520 00000100:00100000:2.0:1783141746.444445:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141746.444450:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520987776:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444481:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520987776:12345-0@lo:400: Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141746.444495:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141746.444500:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520987520:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444525:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520987520:12345-0@lo:400: Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444531:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141746.444549:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987648 00000100:00100000:2.0:1783141746.444552:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987648 00000100:00100000:2.0:1783141746.444567:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988032 00000100:00100000:2.0:1783141746.444569:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988032 00000100:00100000:2.0:1783141746.444588:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987392 00000100:00100000:2.0:1783141746.444591:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987392 00000100:00100000:2.0:1783141746.444599:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520987904 00000100:00100000:2.0:1783141746.444601:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520987904 00000100:00100000:2.0:1783141746.444613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141746.444618:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520987648:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444645:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759520987648:12345-0@lo:400: Request processed in 27us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444650:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141746.444669:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141746.444674:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759520988032:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759520988032:12345-0@lo:400: Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141746.444713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141746.444718:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759520987392:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444740:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759520987392:12345-0@lo:400: Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444745:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141746.444753:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783141746.444758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759520987904:12345-0@lo:400: 00000100:00100000:2.0:1783141746.444779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759520987904:12345-0@lo:400: Request processed in 21us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.444784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783141746.444807:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141746.444811:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141746.444832:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520987264:0@lo:400: 00000100:00100000:2.0:1783141746.444844:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520987776:0@lo:400: 00010000:00080000:2.0:1783141746.444856:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afc700 x1869759520987648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141746.444866:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759520987648:0@lo:400: 00010000:00080000:2.0:1783141746.444895:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afd500 x1869759520987392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141746.444904:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759520987392:0@lo:400: 00010000:00080000:2.0:1783141746.444922:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afc000 x1869759520987904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141746.444929:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759520987904:0@lo:400: 00000100:00100000:2.0:1783141746.444938:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520987520:0@lo:400: 00010000:00080000:2.0:1783141746.444946:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41aff480 x1869759520988032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141746.444953:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759520988032:0@lo:400: 00010000:00010000:0.0:1783141746.565360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141746.948733:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520988160:0@lo:41: 00000100:00100000:2.0:1783141746.948815:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141746.948892:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988160 00000100:00100000:2.0:1783141746.948898:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988160 00000100:00100000:2.0:1783141746.948941:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141746.948949:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520988160:12345-0@lo:41: 00000004:00000024:2.0:1783141746.948992:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783141746.949036:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520988160:12345-0@lo:41: Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141746.949042:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141746.949085:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520988160:0@lo:41: 00010000:00010000:2.0:1783141747.588575:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783141747.807199:0:8805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783141747.974716:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141747.974740:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520988288:0@lo:41: 00000100:00100000:3.0:1783141747.974808:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141747.975670:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988288 00000100:00100000:0.0:1783141747.975679:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988288 00000100:00100000:0.0:1783141747.975730:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141747.975739:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520988288:12345-0@lo:41: 00000004:00000024:0.0:1783141747.975775:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1783141747.975843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520988288:12345-0@lo:41: Request processed in 105us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141747.975851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141747.975929:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520988288:0@lo:41: 10000000:01000000:2.0:1783141748.494212:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783141748.494220:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b4fc000 from 30 10000000:01000000:2.0:1783141748.494226:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783141748.494266:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.494414:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.494426:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141748.494449:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988416:0@lo:101: 00000100:00100000:2.0:1783141748.494526:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.494588:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.495306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988416 00000100:00100000:0.0:1783141748.495316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988416 00000100:00100000:0.0:1783141748.495368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783141748.495377:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:6519:x1869759520988416:12345-0@lo:101: 00010000:00010000:0.0:1783141748.495399:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141748.495411:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806baa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.495435:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806baa expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.495446:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806baa expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.495465:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40031200, rc 0) 00000100:00100000:0.0:1783141748.495514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520988416:12345-0@lo:101: Request processed in 137us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.495520:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783141748.504854:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988416:0@lo:101: 00010000:00010000:2.0:1783141748.504882:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.504907:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141748.505016:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988544:0@lo:501: 00000100:00100000:2.0:1783141748.505077:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.505135:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141748.505595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988544 00000100:00100000:1.0:1783141748.505602:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988544 00000100:00100000:1.0:1783141748.505655:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783141748.505673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520988544:12345-0@lo:501: 00000100:00100000:1.0:1783141748.505830:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520988544:12345-0@lo:501: Request processed in 157us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.505838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783141748.506405:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41aff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988544:0@lo:501: 00000100:00100000:3.0:1783141748.506456:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988672:0@lo:503: 00000100:00100000:3.0:1783141748.506501:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.507646:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.508673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988672 00000100:00100000:2.0:1783141748.508683:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988672 00000100:00100000:2.0:1783141748.508743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783141748.508753:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520988672:12345-0@lo:503: 00000100:00100000:2.0:1783141748.511189:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520988672:12345-0@lo:503: Request processed in 2427us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.511203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783141748.514367:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520988672:0@lo:503: 00000100:00100000:3.0:1783141748.514860:0:8844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8844:1869759520988800:0@lo:502: 00000100:00100000:3.0:1783141748.514929:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.514978:0:8844:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c481400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.515024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988800 00000100:00100000:0.0:1783141748.515030:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988800 00000100:00100000:0.0:1783141748.515086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783141748.515095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8844:x1869759520988800:12345-0@lo:502: 00000100:00100000:0.0:1783141748.515225:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8844:x1869759520988800:12345-0@lo:502: Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.515233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783141748.515406:0:8844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8844:1869759520988800:0@lo:502: 00000100:00100000:3.0:1783141748.515450:0:8844:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8844:1869759520988928:0@lo:502: 00000100:00100000:3.0:1783141748.515485:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.515508:0:8844:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c481400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.515670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520988928 00000100:00100000:0.0:1783141748.515675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520988928 00000100:00100000:0.0:1783141748.515710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783141748.515718:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8844:x1869759520988928:12345-0@lo:502: 00000100:00100000:0.0:1783141748.515800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:8844:x1869759520988928:12345-0@lo:502: Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.515807:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783141748.515905:0:8844:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8844:1869759520988928:0@lo:502: 00000040:00080000:3.0:1783141748.515925:0:8844:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783141748.516701:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783141748.516726:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141748.516735:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.516746:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141748.516755:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783141748.516757:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c7b4fc000 from 5 10000000:01000000:0.0:1783141748.516760:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141748.516787:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.516794:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.516804:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141748.516818:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989056:0@lo:101: 00000100:00100000:0.0:1783141748.516855:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.516888:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b424676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.516972:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989056 00000100:00100000:2.0:1783141748.516978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989056 00000100:00100000:2.0:1783141748.517006:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783141748.517013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759520989056:12345-0@lo:101: 00010000:00010000:2.0:1783141748.517024:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141748.517036:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806bb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.517057:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.517076:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.517085:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3a00, rc 0) 00000100:00100000:2.0:1783141748.517130:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520989056:12345-0@lo:101: Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.517137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783141748.517327:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989056:0@lo:101: 00010000:00010000:3.0:1783141748.517340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.517349:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141748.517393:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989184:0@lo:256: 00000100:00100000:3.0:1783141748.517424:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.517452:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c481400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.519768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989184 00000100:00100000:2.0:1783141748.519780:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989184 00000100:00100000:2.0:1783141748.519833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783141748.519841:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520989184:12345-0@lo:256: 20000000:01000000:2.0:1783141748.519861:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783141748.519875:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783141748.519878:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783141748.519978:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520989184:12345-0@lo:256: Request processed in 137us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.519985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783141748.520027:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989184:0@lo:256: 10000000:01000000:2.0:1783141748.520085:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783141748.520093:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520111:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141748.520119:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783141748.520122:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1783141748.520125:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783141748.520154:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520162:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520170:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141748.520186:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989312:0@lo:101: 00000100:00100000:2.0:1783141748.520216:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.520247:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.520262:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989312 00000100:00100000:2.0:1783141748.520266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989312 00000100:00100000:2.0:1783141748.520316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783141748.520324:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759520989312:12345-0@lo:101: 00010000:00010000:2.0:1783141748.520332:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141748.520344:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806bc6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520376:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520385:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520393:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2400, rc 0) 00000100:00100000:2.0:1783141748.520420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520989312:12345-0@lo:101: Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.520426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783141748.520455:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989312:0@lo:101: 00010000:00010000:2.0:1783141748.520467:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.520476:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141748.521229:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989440:0@lo:501: 00000100:00100000:2.0:1783141748.521266:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.521319:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.521334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989440 00000100:00100000:2.0:1783141748.521338:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989440 00000100:00100000:2.0:1783141748.521364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783141748.521370:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520989440:12345-0@lo:501: 00000100:00100000:2.0:1783141748.521476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520989440:12345-0@lo:501: Request processed in 105us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.521483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783141748.523173:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989440:0@lo:501: 00000100:00100000:2.0:1783141748.523222:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989568:0@lo:503: 00000100:00100000:2.0:1783141748.524189:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.524238:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.524636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989568 00000100:00100000:3.0:1783141748.524644:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989568 00000100:00100000:3.0:1783141748.524693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783141748.524701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520989568:12345-0@lo:503: 00000100:00100000:3.0:1783141748.524839:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520989568:12345-0@lo:503: Request processed in 137us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.524847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783141748.525224:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520989568:0@lo:503: 00000100:00100000:3.0:1783141748.526888:0:8846:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8846:1869759520989696:0@lo:502: 00000100:00100000:3.0:1783141748.526955:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.526990:0:8846:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c481400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.527379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989696 00000100:00100000:2.0:1783141748.527386:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989696 00000100:00100000:2.0:1783141748.527429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783141748.527437:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:8846:x1869759520989696:12345-0@lo:502: 00000100:00100000:2.0:1783141748.527627:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:8846:x1869759520989696:12345-0@lo:502: Request processed in 190us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.527635:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783141748.527743:0:8846:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8846:1869759520989696:0@lo:502: 00000020:01000000:0.0:1783141748.527769:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141748.527775:0:8846:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783141748.527782:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141748.527784:0:8846:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783141748.527796:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141748.527800:0:8846:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:0.0:1783141748.527820:0:8846:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783141748.527822:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141748.527838:0:8846:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f9c74d319c0) 00000020:00000080:0.0:1783141748.527856:0:8846:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783141748.527861:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141748.527939:0:8846:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783141748.527945:0:8846:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783141748.527952:0:8846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3806bdb 00010000:00080000:0.0:1783141748.527981:0:8846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b41a0d800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141748.528825:0:8846:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1783141748.547367:0:8846:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783141748.547390:0:8846:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783141748.547598:0:8846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141748.547800:0:8846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141748.547882:0:8846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783141748.547965:0:8846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1783141748.548533:0:8850:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141748.548539:0:8850:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783141748.549169:0:8846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141748.549182:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783141748.549221:0:8846:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783141748.549240:0:8846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806be2 00000100:00080000:2.0:1783141748.549250:0:8846:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141748.549257:0:8846:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f9b41a0d800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141748.549322:0:8846:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b41afd500 x1869759520989824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141748.549401:0:8846:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1783141748.549491:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520989952:0@lo:400: 00000100:00100000:1.0:1783141748.549670:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759520989824:0@lo:8: 00000100:00100000:1.0:1783141748.549715:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.549772:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520990208:0@lo:400: 00000100:00100000:1.0:1783141748.549796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.549814:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141748.549819:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759520990336:0@lo:400: 00000100:00100000:1.0:1783141748.549855:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990208 00000100:00100000:1.0:1783141748.549861:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990208 00000100:00100000:1.0:1783141748.549951:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141748.549960:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520990208:12345-0@lo:400: 00000100:00100000:1.0:1783141748.550010:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520990208:12345-0@lo:400: Request processed in 51us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.550018:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141748.550134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.550165:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759520990464:0@lo:400: 00000100:00100000:2.0:1783141748.550197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.550218:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141748.550224:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759520990080:0@lo:400: 00000100:00100000:2.0:1783141748.550253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.550486:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989824 00000100:00100000:3.0:1783141748.550491:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989824 00000100:00100000:1.0:1783141748.550547:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.550591:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520990208:0@lo:400: 00000100:00100000:1.0:1783141748.550614:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520989952 00000100:00100000:1.0:1783141748.550618:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520989952 00000100:00100000:1.0:1783141748.550643:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990464 00000100:00100000:1.0:1783141748.550645:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990464 00000100:00100000:1.0:1783141748.550663:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990080 00000100:00100000:1.0:1783141748.550666:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990080 00000100:00100000:1.0:1783141748.550674:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990336 00000100:00100000:1.0:1783141748.550676:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990336 00000100:00100000:1.0:1783141748.550688:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783141748.550695:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520989952:12345-0@lo:400: 00000100:00100000:1.0:1783141748.550733:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759520989952:12345-0@lo:400: Request processed in 39us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.550740:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783141748.550751:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141748.550756:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759520990464:12345-0@lo:400: 00000100:00100000:1.0:1783141748.550778:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759520990464:12345-0@lo:400: Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.550783:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141748.550792:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141748.550797:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759520990080:12345-0@lo:400: 00000100:00100000:1.0:1783141748.550817:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759520990080:12345-0@lo:400: Request processed in 19us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.550822:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141748.550830:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141748.550835:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759520990336:12345-0@lo:400: 00000100:00100000:1.0:1783141748.550859:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759520990336:12345-0@lo:400: Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.550864:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1783141748.550878:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141748.550881:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783141748.550905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afdf80 x1869759520990336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.550917:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759520990336:0@lo:400: 00010000:00080000:1.0:1783141748.550939:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afe680 x1869759520990080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.550948:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759520990080:0@lo:400: 00010000:00080000:1.0:1783141748.550957:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afc700 x1869759520989952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.550965:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759520989952:0@lo:400: 00010000:00080000:1.0:1783141748.550972:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afc000 x1869759520990464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.550980:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759520990464:0@lo:400: 00000100:00100000:3.0:1783141748.554636:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141748.554647:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759520989824:12345-0@lo:8: 00010000:00080000:3.0:1783141748.554684:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1783141748.554716:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806be9 00002000:00100000:3.0:1783141748.554756:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f9c7b4fb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783141748.554761:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1783141748.554765:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783141748.554823:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783141748.555030:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1783141748.555056:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9c74cd9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141748.555157:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759520989824:12345-0@lo:8: Request processed in 509us (5441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.555166:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1783141748.558398:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141748.558407:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.558414:0:8846:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783141748.558421:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141748.558425:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.558426:0:8846:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141748.558429:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141748.558431:0:8846:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783141748.558475:0:8846:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8846:1869759520990592:0@lo:502: 00000100:00100000:3.0:1783141748.559936:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.560001:0:8846:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.560920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990592 00000100:00100000:2.0:1783141748.560930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990592 00000100:00100000:2.0:1783141748.560989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783141748.560998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:8846:x1869759520990592:12345-0@lo:502: 00000100:00100000:2.0:1783141748.561366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:8846:x1869759520990592:12345-0@lo:502: Request processed in 368us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.561374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783141748.561485:0:8846:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8846:1869759520990592:0@lo:502: 00000020:01000000:3.0:1783141748.561517:0:8846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141748.561523:0:8846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.561526:0:8846:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141748.561533:0:8846:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1783141748.561807:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1783141748.561828:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783141748.561838:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.561849:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141748.561859:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783141748.561862:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c4bd6c000 from 30 10000000:01000000:0.0:1783141748.561865:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141748.561894:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.561901:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.561910:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141748.561941:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520990720:0@lo:101: 00000100:00100000:0.0:1783141748.561981:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.562052:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b424676c0 going to sleep for 11 seconds 00010000:00080000:1.0:1783141748.562343:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afd500 x1869759520989824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.562354:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141748.562361:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783141748.562368:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783141748.562373:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783141748.562376:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783141748.562388:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783141748.562393:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759520989824:0@lo:8: 00000100:00100000:1.0:1783141748.562432:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520990848:0@lo:700: 00000100:00100000:1.0:1783141748.562459:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.562477:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.563653:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990848 00000100:00100000:0.0:1783141748.563664:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990848 00000100:00100000:0.0:1783141748.563752:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141748.563761:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8851:x1869759520990848:12345-0@lo:700: 00000100:00100000:0.0:1783141748.563806:0:8446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1869759520990976:0@lo:700: 00000100:00100000:0.0:1783141748.563866:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.563886:0:8446:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1783141748.563900:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141748.564683:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990976 00000100:00100000:2.0:1783141748.564690:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990976 00000100:00100000:2.0:1783141748.564724:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141748.564732:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1869759520990976:12345-0@lo:700: 00000004:00080000:2.0:1783141748.564844:0:8850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783141748.564919:0:8850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 259631646046ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783141748.564925:0:8850:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1783141748.567496:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1783141748.567638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520990720 00000100:00100000:3.0:1783141748.567648:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520990720 00000100:00100000:3.0:1783141748.567704:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783141748.567714:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759520990720:12345-0@lo:101: 00010000:00010000:3.0:1783141748.567728:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141748.567745:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806bf0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.567771:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.567782:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.567791:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3200, rc 0) 00000100:00100000:3.0:1783141748.567861:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520990720:12345-0@lo:101: Request processed in 148us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.567875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783141748.567918:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520990720:0@lo:101: 00010000:00010000:3.0:1783141748.567935:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.567943:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141748.568007:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991104:0@lo:501: 00000100:00100000:3.0:1783141748.568039:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.569675:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991104 00000100:00100000:2.0:1783141748.569686:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991104 00000100:00100000:2.0:1783141748.569720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783141748.569727:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520991104:12345-0@lo:501: 00000100:00100000:2.0:1783141748.569941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520991104:12345-0@lo:501: Request processed in 213us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.569949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783141748.570145:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.570170:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991104:0@lo:501: 00000100:00100000:3.0:1783141748.570214:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991232:0@lo:503: 00000100:00100000:3.0:1783141748.570258:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.570301:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.570336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991232 00000100:00100000:3.0:1783141748.570340:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991232 00000100:00100000:3.0:1783141748.570368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783141748.570375:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520991232:12345-0@lo:503: 00000100:00100000:3.0:1783141748.570668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520991232:12345-0@lo:503: Request processed in 291us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.570675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783141748.570700:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991232:0@lo:503: 00000100:00100000:2.0:1783141748.571874:0:8855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8855:1869759520991360:0@lo:502: 00000100:00100000:2.0:1783141748.571933:0:8855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.571972:0:8855:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.572417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991360 00000100:00100000:0.0:1783141748.572424:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991360 00000100:00100000:0.0:1783141748.572462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141748.572470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:8855:x1869759520991360:12345-0@lo:502: 00000100:00100000:0.0:1783141748.572600:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:8855:x1869759520991360:12345-0@lo:502: Request processed in 130us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.572607:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141748.572659:0:8855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8855:1869759520991360:0@lo:502: 00000100:00100000:0.0:1783141748.572700:0:8855:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8855:1869759520991488:0@lo:502: 00000100:00100000:0.0:1783141748.572732:0:8855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.572753:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991488 00000100:00100000:3.0:1783141748.572758:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991488 00000100:00100000:0.0:1783141748.572760:0:8855:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a4eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.572782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783141748.572788:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:8855:x1869759520991488:12345-0@lo:502: 00000100:00100000:3.0:1783141748.572944:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:8855:x1869759520991488:12345-0@lo:502: Request processed in 155us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.572951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 40000000:02000000:2.0:1783141748.573208:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1783141748.573730:0:8855:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8855:1869759520991488:0@lo:502: 00000040:00080000:0.0:1783141748.573760:0:8855:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783141748.573815:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783141748.573834:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141748.573843:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.573854:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141748.573863:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783141748.573866:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c4bd6c000 from 5 10000000:01000000:0.0:1783141748.573869:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141748.573895:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.573903:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.573912:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141748.573927:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991616:0@lo:101: 00000100:00100000:0.0:1783141748.573963:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.573988:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738180 going to sleep for 11 seconds 00000100:00100000:0.0:1783141748.574002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991616 00000100:00100000:0.0:1783141748.574006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991616 00000100:00100000:0.0:1783141748.574035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783141748.574042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759520991616:12345-0@lo:101: 00010000:00010000:0.0:1783141748.574052:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141748.574641:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806bfe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.574667:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.574678:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.574687:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40030e00, rc 0) 00000100:00100000:0.0:1783141748.574725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759520991616:12345-0@lo:101: Request processed in 684us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.574733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783141748.574772:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991616:0@lo:101: 00010000:00010000:0.0:1783141748.574783:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141748.574792:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141748.574833:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991744:0@lo:256: 00000100:00100000:0.0:1783141748.574861:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.574878:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b738180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.575189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991744 00000100:00100000:3.0:1783141748.575194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991744 00000100:00100000:3.0:1783141748.575232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783141748.575240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759520991744:12345-0@lo:256: 20000000:01000000:3.0:1783141748.575255:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141748.575289:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141748.575293:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783141748.575375:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759520991744:12345-0@lo:256: Request processed in 135us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.575382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783141748.575413:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991744:0@lo:256: 10000000:01000000:3.0:1783141748.575450:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783141748.575458:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575466:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141748.575473:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783141748.575475:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783141748.575479:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141748.575497:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575506:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575530:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141748.575543:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991872:0@lo:101: 00000100:00100000:3.0:1783141748.575569:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.575594:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.575606:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520991872 00000100:00100000:3.0:1783141748.575609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520991872 00000100:00100000:3.0:1783141748.575630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783141748.575636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759520991872:12345-0@lo:101: 00010000:00010000:3.0:1783141748.575644:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141748.575655:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c0c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575669:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575678:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575685:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:3.0:1783141748.575711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520991872:12345-0@lo:101: Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.575716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783141748.575745:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520991872:0@lo:101: 00010000:00010000:3.0:1783141748.575756:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.575774:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141748.575821:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992000:0@lo:501: 00000100:00100000:3.0:1783141748.575845:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.575975:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.575987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992000 00000100:00100000:3.0:1783141748.575990:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992000 00000100:00100000:3.0:1783141748.576012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783141748.576018:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520992000:12345-0@lo:501: 00000100:00100000:3.0:1783141748.576132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520992000:12345-0@lo:501: Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.576139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783141748.576168:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992000:0@lo:501: 00000100:00100000:3.0:1783141748.576192:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992128:0@lo:503: 00000100:00100000:3.0:1783141748.576229:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.576242:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.576252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992128 00000100:00100000:3.0:1783141748.576255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992128 00000100:00100000:3.0:1783141748.576298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783141748.576304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520992128:12345-0@lo:503: 00000100:00100000:3.0:1783141748.576373:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520992128:12345-0@lo:503: Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.576379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783141748.576426:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992128:0@lo:503: 00000100:00100000:1.0:1783141748.578799:0:8856:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8856:1869759520992256:0@lo:502: 00000100:00100000:1.0:1783141748.579125:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.579214:0:8856:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b673900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.579252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992256 00000100:00100000:3.0:1783141748.579260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992256 00000100:00100000:2.0:1783141748.579389:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1869759520990976:12345-0@lo:700: Request processed in 14657us (15521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.579400:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783141748.579445:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6ccc0700 x1869759520990976/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.579460:0:8446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1869759520990976:0@lo:700: 40000000:02000000:1.0:1783141748.579470:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1783141748.581414:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783141748.581426:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:8856:x1869759520992256:12345-0@lo:502: 00000100:00100000:3.0:1783141748.581646:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:8856:x1869759520992256:12345-0@lo:502: Request processed in 221us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.581654:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783141748.581716:0:8856:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8856:1869759520992256:0@lo:502: 00000020:01000000:3.0:1783141748.581747:0:8856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783141748.581756:0:8856:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783141748.581762:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.581764:0:8856:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783141748.581771:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783141748.581775:0:8856:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:3.0:1783141748.581796:0:8856:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783141748.581799:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783141748.581813:0:8856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f9b423019c0) 00000020:00000080:3.0:1783141748.581836:0:8856:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783141748.581842:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783141748.582007:0:8856:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783141748.582012:0:8856:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783141748.582087:0:8856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3806c21 00010000:00080000:3.0:1783141748.582123:0:8856:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c6f70f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783141748.582638:0:8856:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:2.0:1783141748.589039:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783141748.591298:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520990848:12345-0@lo:700: Request processed in 27509us (28808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.591317:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1783141748.591352:0:8856:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783141748.591371:0:8856:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783141748.591569:0:8856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141748.591755:0:8856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141748.591858:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783141748.591944:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783141748.593300:0:8860:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141748.593307:0:8860:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783141748.593741:0:8856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783141748.593753:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783141748.593867:0:8856:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783141748.593890:0:8856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806c28 00000100:00080000:3.0:1783141748.593899:0:8856:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141748.593906:0:8856:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f9c6f70f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783141748.593940:0:8856:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6ccca680 x1869759520992384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141748.593972:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759520992384:0@lo:8: 00000100:00100000:3.0:1783141748.594038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141748.594123:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992384 00000100:00100000:0.0:1783141748.594131:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992384 00000100:00100000:3.0:1783141748.594183:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783141748.594427:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4b3d5c00 x1869759520990848/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141748.594470:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759520992384:12345-0@lo:8: 00010000:00080000:3.0:1783141748.594499:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1783141748.594522:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806c2f 00002000:00100000:3.0:1783141748.594534:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f9c6f708800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783141748.594538:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783141748.594541:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783141748.594603:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520990848:0@lo:700: 00002000:00080000:3.0:1783141748.594731:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783141748.594753:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9c6f70e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141748.594809:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759520992384:12345-0@lo:8: Request processed in 617us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.594818:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783141748.594838:0:8856:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00080000:1.0:1783141748.594959:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6ccca680 x1869759520992384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.594970:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141748.594976:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783141748.594982:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783141748.594987:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783141748.594989:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c6f70f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783141748.595009:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783141748.595014:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759520992384:0@lo:8: 00000020:01000000:3.0:1783141748.595174:0:8856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141748.595179:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.595182:0:8856:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783141748.595185:0:8856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141748.595189:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.595191:0:8856:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141748.595194:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141748.595195:0:8856:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783141748.595221:0:8856:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8856:1869759520992512:0@lo:502: 00000100:00100000:3.0:1783141748.595264:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.595311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992512 00000100:00100000:3.0:1783141748.595316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992512 00000100:00100000:2.0:1783141748.595325:0:8856:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.595347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783141748.595354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:8856:x1869759520992512:12345-0@lo:502: 00000004:00080000:1.0:1783141748.595627:0:8860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783141748.595677:0:8860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 259662403848ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783141748.595683:0:8860:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783141748.596116:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:8856:x1869759520992512:12345-0@lo:502: Request processed in 761us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.596124:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783141748.596177:0:8856:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:8856:1869759520992512:0@lo:502: 00000020:01000000:3.0:1783141748.596198:0:8856:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141748.596203:0:8856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141748.596204:0:8856:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141748.596210:0:8856:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1783141748.596481:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1783141748.596504:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783141748.596513:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.596524:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141748.596534:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783141748.596536:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9c48c28000 from 1 10000000:01000000:2.0:1783141748.596539:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783141748.596615:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.596624:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.596633:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141748.596648:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992640:0@lo:101: 00000100:00100000:2.0:1783141748.596685:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.596723:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.596814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992640 00000100:00100000:3.0:1783141748.596820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992640 00000100:00100000:2.0:1783141748.596928:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783141748.596943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759520992640:12345-0@lo:101: 00010000:00010000:2.0:1783141748.596955:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141748.596966:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.596988:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.596998:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141748.597007:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2e00, rc 0) 00000100:00100000:2.0:1783141748.597048:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759520992640:12345-0@lo:101: Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.597054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00080000:1.0:1783141748.597612:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783141748.597746:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141748.597899:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992640:0@lo:101: 00010000:00010000:3.0:1783141748.597915:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.597925:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141748.597989:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992896:0@lo:501: 00000100:00100000:3.0:1783141748.598022:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.598051:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab180 going to sleep for 11 seconds 00000004:00080000:2.0:1783141748.598164:0:8861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783141748.598183:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993024:0@lo:7: 00000100:00100000:2.0:1783141748.598216:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.598230:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.598252:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993024 00000100:00100000:2.0:1783141748.598256:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993024 00000100:00100000:2.0:1783141748.598316:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141748.598322:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8861:x1869759520993024:12345-0@lo:7: 00000100:00100000:3.0:1783141748.601164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992896 00000100:00100000:3.0:1783141748.601176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992896 00000100:00100000:3.0:1783141748.601238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783141748.601248:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759520992896:12345-0@lo:501: 00000100:00100000:3.0:1783141748.601389:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759520992896:12345-0@lo:501: Request processed in 143us (3365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141748.601397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783141748.601454:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759520992896:0@lo:501: 10000000:01000000:3.0:1783141748.601493:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783141748.601502:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141748.601510:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141748.601598:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520992768:0@lo:13: 00000100:00100000:1.0:1783141748.601637:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1783141748.602120:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783141748.602126:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783141748.602236:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8861:x1869759520993024:12345-0@lo:7: Request processed in 3911us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.602253:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783141748.602291:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141748.602930:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520992768 00000100:00100000:0.0:1783141748.602939:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520992768 00000100:00100000:0.0:1783141748.602982:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141748.602990:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759520992768:12345-0@lo:13: 00002000:00000024:0.0:1783141748.603020:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1783141748.603387:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759520992768:12345-0@lo:13: Request processed in 397us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141748.603395:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783141748.603488:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7628d500 x1869759520992768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141748.603507:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520992768:0@lo:13: 00000004:00080000:1.0:1783141748.605342:0:8851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783141748.605370:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993280:0@lo:7: 00000100:00100000:1.0:1783141748.605426:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.605466:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b673b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.605527:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520993152:0@lo:13: 00000100:00100000:2.0:1783141748.605615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.605700:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993152 00000100:00100000:1.0:1783141748.605707:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993152 00000100:00100000:1.0:1783141748.605755:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141748.605763:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520993152:12345-0@lo:13: 00002000:00000024:1.0:1783141748.605785:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1783141748.605826:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759520993152:12345-0@lo:13: Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.605833:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783141748.605905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4b3d4700 x1869759520993152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141748.605922:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759520993152:0@lo:13: 00000100:00100000:1.0:1783141748.606036:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993280 00000100:00100000:1.0:1783141748.606041:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993280 00010000:00080000:3.0:1783141748.606130:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7628ca80 x1869759520993024/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141748.606140:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993024:0@lo:7: 00000004:00080000:3.0:1783141748.606150:0:8861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783141748.606201:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141748.606210:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520993280:12345-0@lo:7: 00000100:00100000:3.0:1783141748.609632:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993408:0@lo:5: 00000100:00100000:3.0:1783141748.609700:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.609877:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00002000:00080000:1.0:1783141748.610390:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1783141748.610397:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783141748.610453:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520993280:12345-0@lo:7: Request processed in 4243us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.610462:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141748.610662:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1783141748.610732:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4b3d5500 x1869759520993280/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.610747:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993280:0@lo:7: 00000004:00080000:1.0:1783141748.610760:0:8851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783141748.610785:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993536:0@lo:5: 00000100:00100000:1.0:1783141748.610812:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.610831:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141748.610845:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993408 00000100:00100000:1.0:1783141748.610850:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993408 00000100:00100000:1.0:1783141748.610875:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993536 00000100:00100000:1.0:1783141748.610878:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993536 00000100:00100000:1.0:1783141748.610891:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141748.610898:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8861:x1869759520993408:12345-0@lo:5: 00002000:00080000:1.0:1783141748.610923:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783141748.610927:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783141748.611269:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab180 going to sleep for 11 seconds 00010000:00010000:1.0:1783141748.613944:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141748.617782:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141748.617802:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520993536:12345-0@lo:5: 00002000:00080000:2.0:1783141748.617836:0:8865:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783141748.617912:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520993536:12345-0@lo:5: Request processed in 117us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.617918:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00080000:1.0:1783141748.618542:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1783141748.620159:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1783141748.620223:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4b3d5500 x1869759520993536/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141748.620240:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993536:0@lo:5: 00000004:00080000:1.0:1783141748.620254:0:8851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783141748.620308:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993664:0@lo:5: 00000100:00100000:1.0:1783141748.620359:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.620400:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141748.620419:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993664 00000100:00100000:1.0:1783141748.620424:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993664 00000100:00100000:1.0:1783141748.620466:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141748.620474:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8851:x1869759520993664:12345-0@lo:5: 00002000:00080000:1.0:1783141748.620506:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000020:00000004:3.0:1783141748.622230:0:8866:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783141748.622472:0:8866:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783141748.622952:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8861:x1869759520993408:12345-0@lo:5: Request processed in 12050us (13248us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783141748.622963:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783141748.623391:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4427a680 x1869759520993408/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141748.623403:0:8861:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783141748.623410:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993408:0@lo:5: 00000004:00080000:3.0:1783141748.623423:0:8861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783141748.623464:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993792:0@lo:700: 00000100:00100000:3.0:1783141748.623497:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141748.623522:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141748.623541:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993792 00000100:00100000:3.0:1783141748.623547:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993792 00000100:00100000:3.0:1783141748.624537:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141748.624547:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8861:x1869759520993792:12345-0@lo:700: 00000100:00100000:1.0:1783141748.626225:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8851:x1869759520993664:12345-0@lo:5: Request processed in 5744us (5857us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783141748.626238:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783141748.628670:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4b3d5500 x1869759520993664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141748.628689:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8851:1869759520993664:0@lo:5: 00000004:00080000:2.0:1783141748.628702:0:8851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1783141748.628743:0:8851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8851:1869759520993920:0@lo:900: 00000100:00100000:2.0:1783141748.628799:0:8851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141748.628883:0:8851:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aa4540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141748.628947:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520993920 00000100:00100000:1.0:1783141748.628954:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520993920 00000100:00100000:1.0:1783141748.629038:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141748.629047:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8851:x1869759520993920:12345-0@lo:900: 00000100:00100000:1.0:1783141748.629116:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8851:x1869759520993920:12345-0@lo:900: Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.629123:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783141748.629179:0:8851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7628c000 x1869759520993920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141748.629190:0:8851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8851:1869759520993920:0@lo:900: 00000001:00080000:1.0:1783141748.639731:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1783141748.640073:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8861:x1869759520993792:12345-0@lo:700: Request processed in 15523us (16571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.640086:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783141748.640185:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4427a680 x1869759520993792/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141748.640200:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520993792:0@lo:700: 00000004:02000040:0.0:1783141748.641524:0:8861:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1783141748.648602:0:8861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520994048:0@lo:5: 00000100:00100000:1.0:1783141748.648744:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141748.648793:0:8861:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141748.648839:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994048 00000100:00100000:2.0:1783141748.648846:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994048 00000100:00100000:2.0:1783141748.648910:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783141748.648920:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8861:x1869759520994048:12345-0@lo:5: 00002000:00080000:2.0:1783141748.664511:0:8865:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783141748.664532:0:8865:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1783141748.670086:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8861:x1869759520994048:12345-0@lo:5: Request processed in 21160us (21335us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783141748.670265:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783141748.671677:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afd500 x1869759520994048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141748.671697:0:8861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8861:1869759520994048:0@lo:5: 00000004:00080000:3.0:1783141748.671712:0:8861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:2.0:1783141749.461931:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1783141749.636679:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141750.661528:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783141751.412958:0:8967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783141751.413244:0:8967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783141751.691098:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141752.075953:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141752.075978:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520994176:0@lo:41: 00000100:00100000:0.0:1783141752.076045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141752.076163:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994176 00000100:00100000:3.0:1783141752.076171:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994176 00000100:00100000:3.0:1783141752.076222:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141752.076230:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520994176:12345-0@lo:41: 00000004:00000024:3.0:1783141752.076262:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783141752.076332:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520994176:12345-0@lo:41: Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141752.076339:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141752.076391:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520994176:0@lo:41: 00000020:00000004:2.0:1783141752.279646:0:9015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141752.279656:0:9015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1783141752.708701:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141753.092441:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520994304:0@lo:41: 00000100:00100000:2.0:1783141753.092507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141753.092723:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994304 00000100:00100000:1.0:1783141753.092731:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994304 00000100:00100000:1.0:1783141753.092782:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141753.092792:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520994304:12345-0@lo:41: 00000004:00000024:1.0:1783141753.092826:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783141753.092871:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520994304:12345-0@lo:41: Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141753.092879:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783141753.093015:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520994304:0@lo:41: 00000100:00100000:3.0:1783141753.606363:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520994432:0@lo:400: 00000100:00100000:0.0:1783141753.606419:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759520994560:0@lo:400: 00000100:00100000:3.0:1783141753.606452:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141753.606471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141753.606505:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759520994944:0@lo:400: 00000100:00100000:0.0:1783141753.606506:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759520995072:0@lo:400: 00000100:00100000:3.0:1783141753.606548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141753.606582:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783141753.606588:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994560 00000100:00100000:3.0:1783141753.606591:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520994816:0@lo:400: 00000100:00100000:0.0:1783141753.606598:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994560 00000100:00100000:3.0:1783141753.606621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141753.606643:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520995328:0@lo:400: 00000100:00100000:0.0:1783141753.606649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994944 00000100:00100000:0.0:1783141753.606654:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994944 00000100:00100000:3.0:1783141753.606669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141753.606690:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783141753.606700:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994816 00000100:00100000:3.0:1783141753.606705:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994816 00000100:00100000:3.0:1783141753.606734:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141753.606742:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520994816:12345-0@lo:400: 00000100:00100000:2.0:1783141753.606793:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759520994688:0@lo:400: 00000100:00100000:3.0:1783141753.606807:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520994816:12345-0@lo:400: Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141753.606815:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141753.606830:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141753.606842:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994688 00000100:00100000:2.0:1783141753.606849:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520995200:0@lo:400: 00000100:00100000:3.0:1783141753.606855:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994688 00000100:00100000:3.0:1783141753.606885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783141753.606886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141753.606898:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759520994944:12345-0@lo:400: 00000100:00100000:2.0:1783141753.606924:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520994432 00000100:00100000:2.0:1783141753.606929:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520994432 00000100:00100000:3.0:1783141753.606936:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759520994944:12345-0@lo:400: Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141753.606943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141753.606960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141753.606967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783141753.606969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759520994688:12345-0@lo:400: 00000100:00100000:2.0:1783141753.606980:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3653:x1869759520994432:12345-0@lo:400: 00000100:00100000:3.0:1783141753.607013:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759520994688:12345-0@lo:400: Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141753.607020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141753.607026:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3653:x1869759520994432:12345-0@lo:400: Request processed in 46us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141753.607034:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1783141753.607064:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afdc00 x1869759520994688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141753.607089:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141753.607096:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759520994688:0@lo:400: 00000100:00100000:2.0:1783141753.607103:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995328 00000100:00100000:2.0:1783141753.607109:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995328 00000100:00100000:3.0:1783141753.607131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141753.607153:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995200 00000100:00100000:2.0:1783141753.607157:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995200 00000100:00100000:3.0:1783141753.607163:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995072 00000100:00100000:3.0:1783141753.607168:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995072 00000100:00100000:2.0:1783141753.607183:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141753.607193:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520995328:12345-0@lo:400: 00000100:00100000:3.0:1783141753.607196:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141753.607208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759520995072:12345-0@lo:400: 00000100:00100000:2.0:1783141753.607235:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520995328:12345-0@lo:400: Request processed in 44us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141753.607243:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141753.607253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759520995072:12345-0@lo:400: Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141753.607260:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141753.607261:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141753.607292:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520995200:12345-0@lo:400: 00010000:00080000:3.0:1783141753.607326:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f766a00 x1869759520995072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141753.607334:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520995200:12345-0@lo:400: Request processed in 64us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141753.607341:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759520995072:0@lo:400: 00000100:00100000:2.0:1783141753.607346:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783141753.607379:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f766d80 x1869759520995200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141753.607394:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141753.607395:0:3655:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:2.0:1783141753.607400:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141753.607410:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520995200:0@lo:400: 00000100:00100000:3.0:1783141753.607438:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520994816:0@lo:400: 00010000:00080000:3.0:1783141753.607450:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f767b80 x1869759520995328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141753.607458:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1783141753.607465:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759520994560:12345-0@lo:400: 00000100:00100000:3.0:1783141753.607468:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520995328:0@lo:400: 00000100:00100000:3.0:1783141753.607483:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759520994432:0@lo:400: 00010000:00080000:3.0:1783141753.607495:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f764380 x1869759520994944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141753.607503:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759520994944:0@lo:400: 00000100:00100000:0.0:1783141753.607520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759520994560:12345-0@lo:400: Request processed in 820us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141753.607534:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783141753.607569:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afdf80 x1869759520994560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141753.607580:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759520994560:0@lo:400: 00000100:00100000:0.0:1783141753.608112:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141753.608125:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520995456:0@lo:13: 00000100:00100000:0.0:1783141753.608344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141753.608908:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995456 00000100:00100000:1.0:1783141753.608916:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995456 00000100:00100000:1.0:1783141753.608966:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141753.608975:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759520995456:12345-0@lo:13: 00002000:00000024:1.0:1783141753.609001:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141753.609054:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759520995456:12345-0@lo:13: Request processed in 80us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141753.609082:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783141753.609353:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f765880 x1869759520995456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141753.609373:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520995456:0@lo:13: 00010000:00010000:2.0:1783141753.734952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141754.116618:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141754.116644:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520995584:0@lo:13: 00000100:00100000:2.0:1783141754.116712:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141754.116765:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995584 00000100:00100000:0.0:1783141754.116773:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995584 00000100:00100000:0.0:1783141754.116822:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141754.116831:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520995584:12345-0@lo:13: 00002000:00000024:0.0:1783141754.116853:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141754.116918:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759520995584:12345-0@lo:13: Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141754.116927:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783141754.116996:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c44278700 x1869759520995584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141754.117014:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759520995584:0@lo:13: 00010000:00010000:1.0:1783141754.756733:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141755.786704:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141756.804873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141757.188448:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520995712:0@lo:41: 00000100:00100000:0.0:1783141757.188533:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141757.188638:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995712 00000100:00100000:1.0:1783141757.188646:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995712 00000100:00100000:1.0:1783141757.188700:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783141757.188709:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759520995712:12345-0@lo:41: 00000004:00000024:1.0:1783141757.188740:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783141757.192208:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759520995712:12345-0@lo:41: Request processed in 3491us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141757.192223:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783141757.192539:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759520995712:0@lo:41: 00010000:00010000:0.0:1783141757.840701:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141758.214798:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520995840:0@lo:41: 00000100:00100000:3.0:1783141758.214870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141758.214962:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995840 00000100:00100000:1.0:1783141758.214970:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995840 00000100:00100000:1.0:1783141758.215018:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783141758.215026:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520995840:12345-0@lo:41: 00000004:00000024:1.0:1783141758.215066:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783141758.224657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520995840:12345-0@lo:41: Request processed in 9624us (9780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141758.224671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783141758.228407:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520995840:0@lo:41: 00000100:00100000:0.0:1783141758.724684:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520995968:0@lo:13: 00000100:00100000:0.0:1783141758.724765:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.724909:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520995968 00000100:00100000:3.0:1783141758.724917:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520995968 00000100:00100000:3.0:1783141758.724980:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141758.724991:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520995968:12345-0@lo:13: 00002000:00000024:3.0:1783141758.725018:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141758.725079:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759520995968:12345-0@lo:13: Request processed in 91us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.725087:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783141758.725126:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c44279500 x1869759520995968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.725145:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759520995968:0@lo:13: 00000100:00080000:0.0:1783141758.725241:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141758.728510:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520996224:0@lo:400: 00000100:00100000:3.0:1783141758.728591:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728620:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759520996736:0@lo:400: 00000100:00100000:3.0:1783141758.728644:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728666:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141758.728672:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520996096:0@lo:400: 00000100:00100000:3.0:1783141758.728698:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728729:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759520996608:0@lo:400: 00000100:00100000:3.0:1783141758.728766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728794:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759520996352:0@lo:400: 00000100:00100000:3.0:1783141758.728816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728834:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520996864:0@lo:400: 00000100:00100000:3.0:1783141758.728854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728872:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141758.728877:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520996480:0@lo:400: 00000100:00100000:3.0:1783141758.728899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141758.728926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996224 00000100:00100000:3.0:1783141758.728934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996224 00000100:00100000:3.0:1783141758.728971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996736 00000100:00100000:3.0:1783141758.728974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996736 00000100:00100000:3.0:1783141758.729006:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996608 00000100:00100000:3.0:1783141758.729009:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996608 00000100:00100000:3.0:1783141758.729020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996352 00000100:00100000:3.0:1783141758.729022:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996352 00000100:00100000:3.0:1783141758.729047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141758.729055:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520996224:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759520996224:12345-0@lo:400: Request processed in 52us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141758.729130:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141758.729136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759520996736:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729161:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759520996736:12345-0@lo:400: Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729167:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141758.729177:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141758.729182:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759520996608:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729207:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759520996608:12345-0@lo:400: Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729213:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141758.729222:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141758.729227:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759520996352:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759520996352:12345-0@lo:400: Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141758.729312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996096 00000100:00100000:3.0:1783141758.729316:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996096 00000100:00100000:3.0:1783141758.729343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783141758.729349:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3655:x1869759520996096:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3655:x1869759520996096:12345-0@lo:400: Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783141758.729430:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996864 00000100:00100000:3.0:1783141758.729433:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996864 00000100:00100000:3.0:1783141758.729462:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141758.729468:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520996864:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729497:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759520996864:12345-0@lo:400: Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729502:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141758.729518:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996480 00000100:00100000:3.0:1783141758.729521:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996480 00000100:00100000:3.0:1783141758.729545:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141758.729551:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759520996480:12345-0@lo:400: 00000100:00100000:3.0:1783141758.729581:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759520996480:12345-0@lo:400: Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141758.729587:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1783141758.729610:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141758.729614:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141758.729616:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141758.729642:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759520996480:0@lo:400: 00010000:00080000:3.0:1783141758.729655:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c4427a680 x1869759520996352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.729664:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759520996352:0@lo:400: 00010000:00080000:3.0:1783141758.729672:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afc700 x1869759520996864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.729692:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759520996864:0@lo:400: 00000100:00100000:3.0:1783141758.729727:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520996096:0@lo:400: 00010000:00080000:3.0:1783141758.729737:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afdf80 x1869759520996608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.729746:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759520996608:0@lo:400: 00010000:00080000:3.0:1783141758.729754:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c44278700 x1869759520996224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.729760:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759520996224:0@lo:400: 00010000:00080000:3.0:1783141758.729768:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b41afe680 x1869759520996736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141758.729774:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759520996736:0@lo:400: 00010000:00010000:1.0:1783141758.853013:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141759.240520:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520996992:0@lo:13: 00000100:00100000:0.0:1783141759.240624:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141759.240820:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520996992 00000100:00100000:1.0:1783141759.240829:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520996992 00000100:00100000:1.0:1783141759.240884:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141759.240894:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520996992:12345-0@lo:13: 00002000:00000024:1.0:1783141759.240918:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141759.240966:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759520996992:12345-0@lo:13: Request processed in 73us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141759.240991:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783141759.241045:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f767800 x1869759520996992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141759.241064:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759520996992:0@lo:13: 00010000:00010000:0.0:1783141759.882679:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141760.907167:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141761.924407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141762.311074:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520997120:0@lo:41: 00000100:00100000:2.0:1783141762.311147:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141762.311302:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997120 00000100:00100000:3.0:1783141762.311309:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997120 00000100:00100000:3.0:1783141762.311366:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783141762.311375:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520997120:12345-0@lo:41: 00000004:00000024:3.0:1783141762.311408:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783141762.311563:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759520997120:12345-0@lo:41: Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141762.311571:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141762.311658:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759520997120:0@lo:41: 00010000:00010000:1.0:1783141762.948564:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141762.984227:0:9515:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783141762.984230:0:9515:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783141762.984231:0:9515:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783141762.984658:0:9515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9c6f70d800 00000020:01000004:3.0:1783141762.984674:0:9515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783141762.984694:0:9515:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783141762.984709:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f9b42303380) 00000020:00000080:3.0:1783141762.984726:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783141763.065032:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783141763.066042:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1783141763.127898:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783141763.128254:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783141763.128266:0:9515:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783141763.128447:0:9515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb31399d6a3806c4b 00000020:01000004:0.0:1783141763.128454:0:9515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783141763.128476:0:9515:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783141763.128480:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783141763.128487:0:9515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783141763.128516:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783141763.128519:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783141763.164898:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783141763.164936:0:9515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783141763.164941:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783141763.164942:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141763.164944:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141763.164945:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141763.164946:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141763.164947:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141763.164949:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141763.164950:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783141763.164951:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783141763.164953:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141763.164954:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783141763.164957:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783141763.164960:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783141763.164961:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141763.164962:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141763.164963:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141763.164964:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141763.164965:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141763.164966:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141763.164967:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783141763.164968:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783141763.164969:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141763.164970:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783141763.165016:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783141763.165036:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520997248:0@lo:253: 00000100:00100000:1.0:1783141763.165118:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141763.165170:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.165713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997248 00000100:00100000:2.0:1783141763.165722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997248 00000100:00100000:2.0:1783141763.165771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783141763.165779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:9515:x1869759520997248:12345-0@lo:253: 20000000:01000000:2.0:1783141763.165817:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783141763.165821:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783141763.165825:0:6515:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783141763.165828:0:6515:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783141763.166059:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141763.166177:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1783141763.166192:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1783141763.166208:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1783141763.166215:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1783141763.166227:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1783141763.166242:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1783141763.166371:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1783141763.166385:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141763.166387:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141763.166403:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1783141763.166409:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783141763.166423:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1783141763.166429:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141763.166441:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1783141763.166447:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783141763.166461:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1783141763.166475:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1783141763.166543:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1783141763.166629:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141763.166631:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141763.166647:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1783141763.166652:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783141763.166663:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1783141763.166667:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141763.166679:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1783141763.166694:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783141763.166709:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1783141763.166723:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1783141763.167085:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1783141763.167098:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:2.0:1783141763.167099:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:2.0:1783141763.167113:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1783141763.167118:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783141763.167130:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1783141763.167135:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:2.0:1783141763.167148:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1783141763.167154:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783141763.167182:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1783141763.167201:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1783141763.167214:0:6515:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783141763.167217:0:6515:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783141763.167220:0:6515:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783141763.167261:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783141763.167263:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783141763.170514:0:9521:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1783141763.170689:0:9521:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1783141763.170708:0:9521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1783141763.170933:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1783141763.170958:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1783141763.170973:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1783141763.170984:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783141763.170986:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783141763.171797:0:9522:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1783141763.171833:0:9522:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1783141763.171845:0:9522:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783141763.172031:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783141763.172054:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1783141763.172151:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1783141763.172163:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783141763.172165:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783141763.172936:0:9523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1783141763.173168:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1783141763.173189:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1783141763.173629:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1783141763.173644:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1783141763.173647:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783141763.174181:0:9524:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1783141763.174794:0:9524:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1783141763.174821:0:9524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1783141763.175032:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1783141763.175053:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1783141763.175148:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1783141763.175160:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783141763.175162:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783141763.177741:0:9525:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1783141763.177790:0:9525:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1783141763.177807:0:9525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1783141763.178145:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1783141763.178173:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1783141763.178189:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1783141763.178664:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783141763.178740:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178759:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178766:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178772:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806baa expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178778:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178785:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178791:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178798:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178805:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178853:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.178865:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.178880:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997376:0@lo:104: 00000100:00100000:3.0:1783141763.178939:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141763.178994:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.179011:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 21 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.179020:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997504:0@lo:104: 00000100:00100000:3.0:1783141763.179041:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141763.179156:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.179164:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.179172:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997632:0@lo:104: 00000100:00100000:3.0:1783141763.179193:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141763.179486:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.179495:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.179516:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997760:0@lo:104: 00000100:00100000:3.0:1783141763.179542:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.179569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997376 00000100:00100000:2.0:1783141763.179581:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997376 00000100:00100000:2.0:1783141763.179614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997504 00000100:00100000:2.0:1783141763.179617:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997504 00000100:00100000:2.0:1783141763.179627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997632 00000100:00100000:2.0:1783141763.179629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997632 00000100:00100000:2.0:1783141763.179640:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141763.179647:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520997376:12345-0@lo:104: 00010000:00010000:2.0:1783141763.179658:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179710:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141763.179716:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520997376:12345-0@lo:104: Request processed in 69us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.179723:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141763.179739:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783141763.179746:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520997504:12345-0@lo:104: 00010000:00010000:2.0:1783141763.179753:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179782:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783141763.179786:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520997504:12345-0@lo:104: Request processed in 42us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.179792:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783141763.179803:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783141763.179808:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520997632:12345-0@lo:104: 00010000:00010000:2.0:1783141763.179815:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179838:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783141763.179849:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520997632:12345-0@lo:104: Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.179854:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1783141763.179873:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783141763.179878:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179884:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141763.179888:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179897:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141763.179904:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141763.179909:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141763.179933:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179939:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141763.179956:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179962:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3806c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179973:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141763.179976:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.179992:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141763.179995:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180010:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141763.180017:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141763.180022:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141763.180036:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180042:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141763.180057:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180074:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3a00/0xb31399d6a3806c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180085:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141763.180087:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180092:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031e00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141763.180095:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180110:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141763.180117:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141763.180123:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141763.180136:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180142:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141763.180148:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180155:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031e00/0xb31399d6a3806bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bf7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180164:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141763.180165:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141763.180167:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141763.180179:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520997888:0@lo:103: 00010000:00010000:0.0:1783141763.180564:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141763.180682:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.180733:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998016:0@lo:103: 00000100:00100000:2.0:1783141763.180758:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.180777:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141763.180782:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998144:0@lo:103: 00000100:00100000:2.0:1783141763.180801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.180829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997888 00000100:00100000:2.0:1783141763.180842:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997888 00010000:00010000:2.0:1783141763.180864:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 22 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.180879:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998016 00000100:00100000:2.0:1783141763.180882:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998016 00010000:00010000:2.0:1783141763.180892:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 23 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.180900:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998144 00000100:00100000:2.0:1783141763.180902:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998144 00010000:00010000:2.0:1783141763.180927:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 24 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.180941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141763.180948:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759520997888:12345-0@lo:103: 00010000:00010000:2.0:1783141763.180959:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141763.180964:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 24 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180974:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 24 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.180990:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141763.181032:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759520997888:12345-0@lo:103: Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.181039:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141763.181054:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141763.181148:0:6509:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783141763.181156:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783141763.181685:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3652:x1869759520998016:12345-0@lo:103: 00010000:00010000:2.0:1783141763.181695:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141763.181707:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 23 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.181716:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 23 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.181727:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141763.181769:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3652:x1869759520998016:12345-0@lo:103: Request processed in 709us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.181776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783141763.181792:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783141763.181799:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3652:x1869759520998144:12345-0@lo:103: 00010000:00010000:2.0:1783141763.181807:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141763.181812:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 22 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.181821:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 22 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.181830:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141763.181850:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3652:x1869759520998144:12345-0@lo:103: Request processed in 51us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.181855:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783141763.181893:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520997888:0@lo:103: 00000100:00100000:0.0:1783141763.181995:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998144:0@lo:103: 00000100:00100000:0.0:1783141763.182014:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998016:0@lo:103: 00000100:00100000:2.0:1783141763.182508:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520997760 00000100:00100000:2.0:1783141763.182514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520997760 00000100:00100000:2.0:1783141763.182536:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783141763.182541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520997760:12345-0@lo:104: 00010000:00010000:3.0:1783141763.182646:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.182657:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 21 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182668:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998272:0@lo:104: 00000100:00100000:3.0:1783141763.182698:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141763.182713:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.182720:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182728:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998400:0@lo:104: 00000100:00100000:3.0:1783141763.182747:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141763.182760:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.182767:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182774:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998528:0@lo:104: 00000100:00100000:3.0:1783141763.182803:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad0240 going to sleep for 11 seconds 00010000:00010000:3.0:1783141763.182818:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806c36 expref: 21 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182838:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997376:0@lo:104: 00010000:00010000:3.0:1783141763.182849:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3000/0xb31399d6a3806c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806c0c expref: 20 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182856:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997504:0@lo:104: 00010000:00010000:3.0:1783141763.182863:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806bf0 expref: 19 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.182870:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997632:0@lo:104: 00010000:00010000:2.0:1783141763.182912:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.183024:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520997760:0@lo:104: 00010000:00010000:2.0:1783141763.183050:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141763.183056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520997760:12345-0@lo:104: Request processed in 514us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.183070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783141763.183091:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783141763.183104:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.183111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998272 00000100:00100000:2.0:1783141763.183114:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998272 00000100:00100000:2.0:1783141763.183127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998400 00000100:00100000:2.0:1783141763.183129:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998400 00000100:00100000:2.0:1783141763.183136:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998528 00000100:00100000:2.0:1783141763.183138:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998528 00000100:00100000:2.0:1783141763.183148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141763.183153:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520998272:12345-0@lo:104: 00010000:00010000:2.0:1783141763.183159:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141763.183230:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998272:0@lo:104: 00010000:00010000:0.0:1783141763.183673:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141763.183680:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183687:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3800 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.183691:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183699:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.183714:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.183720:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.183757:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183763:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.183781:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183788:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3800/0xb31399d6a3806bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183800:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141763.183802:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183808:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.183811:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183817:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.183822:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.183827:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.183847:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183852:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.183857:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183863:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a3806baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.183872:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.183873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.183875:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141763.183887:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520998656:0@lo:103: 00000100:00100000:0.0:1783141763.183924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.183957:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141763.183963:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520998784:0@lo:103: 00000100:00100000:0.0:1783141763.183983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.184023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998656 00000100:00100000:0.0:1783141763.184028:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998656 00010000:00010000:0.0:1783141763.184047:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 19 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.184227:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998784 00000100:00100000:0.0:1783141763.184232:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998784 00010000:00010000:0.0:1783141763.184245:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 20 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.184292:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141763.184300:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759520998656:12345-0@lo:103: 00000100:00100000:1.0:1783141763.184438:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783141763.184447:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759520998784:12345-0@lo:103: 00010000:00010000:1.0:1783141763.184457:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141763.184462:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 20 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.184480:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 20 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.184492:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40031200/0xb31399d6a3806bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806baa expref: 20 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.184504:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141763.184542:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:3654:x1869759520998784:12345-0@lo:103: Request processed in 97us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.184560:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1783141763.184710:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141763.184715:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 18 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.184725:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 18 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.184734:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a3806bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806bc6 expref: 18 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.184742:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141763.184766:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:3654:x1869759520998656:12345-0@lo:103: Request processed in 468us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.184775:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141763.184828:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520998784:0@lo:103: 00000100:00100000:0.0:1783141763.184835:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759520998656:0@lo:103: 00010000:00010000:2.0:1783141763.185038:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783141763.185045:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:6515:x1869759520998272:12345-0@lo:104: Request processed in 1891us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.185054:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783141763.185186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141763.185207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b42311050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520998400:12345-0@lo:104: 00010000:00010000:3.0:1783141763.185219:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.185343:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998400:0@lo:104: 00010000:00010000:0.0:1783141763.186068:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141763.186076:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186085:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.186088:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186097:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.186103:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.186119:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.186151:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186157:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.186175:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186182:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2600/0xb31399d6a3806b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b72 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186196:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.186198:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.186212:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141763.186226:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998912:0@lo:103: 00000100:00100000:0.0:1783141763.186265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.186352:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520998912 00000100:00100000:0.0:1783141763.186357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520998912 00010000:00010000:0.0:1783141763.186378:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 17 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.186404:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141763.186411:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:3652:x1869759520998912:12345-0@lo:103: 00010000:00010000:0.0:1783141763.186420:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141763.186425:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 17 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186433:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 17 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186452:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806b6b expref: 17 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.186462:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141763.186491:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3652:x1869759520998912:12345-0@lo:103: Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.186498:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141763.186527:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520998912:0@lo:103: 00010000:00010000:3.0:1783141763.187069:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1783141763.187078:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b42311050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6515:x1869759520998400:12345-0@lo:104: Request processed in 1883us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.187086:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141763.187124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141763.187133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520998528:12345-0@lo:104: 00010000:00010000:3.0:1783141763.187143:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.187815:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869759520998528:0@lo:104: 00010000:00010000:1.0:1783141763.187847:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.187986:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141763.187992:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.188010:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40030600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.188014:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.188022:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.188029:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.188034:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.188080:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.188087:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.188111:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.188129:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b48 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.188144:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.188146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.188148:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141763.188155:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141763.188168:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520999040:0@lo:103: 00000100:00100000:0.0:1783141763.188511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.188630:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999040 00000100:00100000:2.0:1783141763.188637:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999040 00010000:00010000:2.0:1783141763.188664:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 16 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.188692:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141763.188700:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3652:x1869759520999040:12345-0@lo:103: 00010000:00010000:2.0:1783141763.188718:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141763.188723:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 16 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188733:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 16 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188745:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806b41 expref: 16 pid: 6515 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188758:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188765:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188778:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188784:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188790:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188796:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188801:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141763.188804:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188821:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188834:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188844:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141763.188874:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3652:x1869759520999040:12345-0@lo:103: Request processed in 175us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.188882:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783141763.188907:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188914:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.188919:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3e00/0xb31399d6a3806c52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141763.188931:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783141763.189945:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759520999040:0@lo:103: 00000100:00100000:2.0:1783141763.191726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:9515:x1869759520997248:12345-0@lo:253: Request processed in 25941us (26602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.191738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783141763.191863:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520997248:0@lo:253: 10000000:01000000:1.0:1783141763.191878:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783141763.191881:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783141763.191883:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141763.191884:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141763.191885:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783141763.191887:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141763.191888:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141763.191890:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141763.191891:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783141763.191894:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141763.191895:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783141763.191914:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c6f70d800 from lustre-OST0001 10000000:01000000:1.0:1783141763.191944:0:9515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783141763.191947:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783141763.191964:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9c48c28000 local copy 10000000:01000000:1.0:1783141763.191968:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783141763.192015:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.192025:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.192035:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.192053:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999168:0@lo:101: 00000100:00100000:1.0:1783141763.192158:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141763.192774:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.192884:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999168 00000100:00100000:2.0:1783141763.192891:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999168 00000100:00100000:2.0:1783141763.192943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783141763.192952:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:9515:x1869759520999168:12345-0@lo:101: 00010000:00010000:2.0:1783141763.192965:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141763.192980:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c59 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.193025:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c59 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.193036:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c59 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.193044:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2e00, rc 0) 00000100:00100000:2.0:1783141763.193104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999168:12345-0@lo:101: Request processed in 153us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.193110:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783141763.193325:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999168:0@lo:101: 00010000:00010000:1.0:1783141763.193340:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.193350:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.193443:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999296:0@lo:501: 00000100:00100000:1.0:1783141763.193487:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141763.193516:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.193676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999296 00000100:00100000:0.0:1783141763.193681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999296 00000100:00100000:0.0:1783141763.193718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783141763.193726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999296:12345-0@lo:501: 00000100:00100000:0.0:1783141763.193787:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999296:12345-0@lo:501: Request processed in 62us (300us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141763.193794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:3.0:1783141763.193880:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1783141763.193889:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6515:x1869759520998528:12345-0@lo:104: Request processed in 6757us (10782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.193896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783141763.193953:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141763.194014:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999296:0@lo:501: 10000000:01000000:1.0:1783141763.194028:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783141763.194047:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783141763.194053:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.194079:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.194086:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.194106:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783141763.194132:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c6f70d800 10000000:01000000:1.0:1783141763.194137:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783141763.194142:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783141763.194145:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141763.194149:0:9515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783141763.194152:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783141763.194170:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.194177:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.194185:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.194197:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999424:0@lo:101: 00010000:00010000:0.0:1783141763.194357:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141763.194363:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194371:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.194375:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194382:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.194397:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.194402:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.194419:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194426:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.194457:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194465:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb31399d6a3806c60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194477:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.194479:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.194480:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141763.194487:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141763.194496:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520999552:0@lo:103: 00000100:00100000:0.0:1783141763.194525:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.194562:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999552 00000100:00100000:0.0:1783141763.194565:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999552 00000100:00100000:0.0:1783141763.194591:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141763.194597:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3655:x1869759520999552:12345-0@lo:103: 00010000:00010000:0.0:1783141763.194607:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141763.194617:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806c59 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.194629:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141763.194657:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:3655:x1869759520999552:12345-0@lo:103: Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.194663:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141763.194686:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759520999552:0@lo:103: 00000100:00100000:1.0:1783141763.194914:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141763.194943:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141763.194980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999424 00000100:00100000:3.0:1783141763.194984:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999424 00000100:00100000:3.0:1783141763.195024:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783141763.195030:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+14:9515:x1869759520999424:12345-0@lo:101: 00010000:00010000:3.0:1783141763.195040:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141763.195051:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c67 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.195075:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.195085:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141763.195091:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3200, rc 0) 00000100:00100000:3.0:1783141763.195120:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999424:12345-0@lo:101: Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.195126:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783141763.195394:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999424:0@lo:101: 00010000:00010000:1.0:1783141763.195406:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.195426:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141763.195507:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999680:0@lo:501: 00000100:00100000:1.0:1783141763.195530:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141763.195657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999680 00000100:00100000:3.0:1783141763.195662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999680 00000100:00100000:3.0:1783141763.195689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783141763.195696:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999680:12345-0@lo:501: 00000100:00100000:3.0:1783141763.196182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999680:12345-0@lo:501: Request processed in 486us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.196198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783141763.196754:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.196774:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999680:0@lo:501: 00000100:00100000:0.0:1783141763.197172:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999808:0@lo:503: 00000100:00100000:0.0:1783141763.197532:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.197641:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141763.197678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999808 00000100:00100000:1.0:1783141763.197684:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999808 00000100:00100000:1.0:1783141763.197747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783141763.197755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999808:12345-0@lo:503: 00000100:00100000:1.0:1783141763.197850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999808:12345-0@lo:503: Request processed in 95us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.197857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783141763.197920:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999808:0@lo:503: 00000040:00080000:0.0:1783141763.198155:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141763.198219:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999936:0@lo:502: 00000100:00100000:0.0:1783141763.198252:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.198714:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.198806:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759520999936 00000100:00100000:2.0:1783141763.198811:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759520999936 00000100:00100000:3.0:1783141763.198891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783141763.198898:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999936:12345-0@lo:502: 00000100:00100000:3.0:1783141763.199028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759520999936:12345-0@lo:502: Request processed in 129us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.199035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783141763.199623:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759520999936:0@lo:502: 00000040:00080000:2.0:1783141763.199811:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783141763.199836:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783141763.199847:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783141763.199857:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783141763.199868:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783141763.199878:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783141763.199901:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000064:0@lo:502: 00000100:00100000:2.0:1783141763.199940:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.199973:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141763.200036:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000064 00000100:00100000:1.0:1783141763.200042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000064 00000100:00100000:1.0:1783141763.200777:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783141763.200789:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759521000064:12345-0@lo:502: 00000100:00100000:1.0:1783141763.200993:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759521000064:12345-0@lo:502: Request processed in 207us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.201010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783141763.204050:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000064:0@lo:502: 00000040:00080000:2.0:1783141763.204159:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783141763.204174:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1783141763.205172:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141763.205180:0:9527:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1783141763.205187:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141763.205190:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783141763.205196:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141763.205233:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f9b43013380) 00000020:00000080:0.0:1783141763.205257:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783141763.205264:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783141763.205381:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f70d800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783141763.205390:0:9527:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783141763.205403:0:9527:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb31399d6a3806c7c 00010000:00010000:0.0:1783141763.221807:0:9527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1783141763.222524:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1783141763.230395:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783141763.232795:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783141763.238302:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1783141763.238531:0:9527:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1783141763.248801:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783141763.250179:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783141763.250190:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141763.250197:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141763.250208:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783141763.250213:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141763.250218:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141763.250220:0:9527:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141763.250223:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141763.250224:0:9527:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783141763.250243:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141763.250246:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141763.250247:0:9527:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141763.250250:0:9527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783141763.250559:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1783141763.250587:0:9515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783141763.250614:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250625:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.250634:0:9515:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f70d800 from 1 10000000:01000000:0.0:1783141763.250637:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141763.250669:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250678:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250688:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.250710:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000192:0@lo:101: 00000100:00100000:0.0:1783141763.250777:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.250815:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000192 00000100:00100000:0.0:1783141763.250822:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000192 00000100:00100000:0.0:1783141763.250863:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783141763.250871:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:9515:x1869759521000192:12345-0@lo:101: 00010000:00010000:0.0:1783141763.250886:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141763.250897:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c83 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250917:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250935:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.250942:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40030a00, rc 0) 00000100:00100000:0.0:1783141763.250974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000192:12345-0@lo:101: Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.250981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783141763.251046:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.251077:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000192:0@lo:101: 00010000:00010000:0.0:1783141763.251091:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.251100:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.251177:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000320:0@lo:501: 00000100:00100000:0.0:1783141763.251213:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.251238:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000320 00000100:00100000:0.0:1783141763.251241:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000320 00000100:00100000:0.0:1783141763.251263:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783141763.251297:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000320:12345-0@lo:501: 00000100:00100000:0.0:1783141763.251378:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000320:12345-0@lo:501: Request processed in 107us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.251384:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783141763.251408:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.251421:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000320:0@lo:501: 00000100:00100000:0.0:1783141763.251454:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000448:0@lo:503: 00000100:00100000:0.0:1783141763.251486:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.251503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000448 00000100:00100000:0.0:1783141763.251506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000448 00000100:00100000:0.0:1783141763.251525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783141763.251531:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000448:12345-0@lo:503: 00000100:00100000:0.0:1783141763.251596:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000448:12345-0@lo:503: Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.251601:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783141763.251633:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.251645:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000448:0@lo:503: 00000040:00080000:0.0:1783141763.251867:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141763.251925:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000576:0@lo:502: 00000100:00100000:0.0:1783141763.251958:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.251980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000576 00000100:00100000:0.0:1783141763.251984:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000576 00000100:00100000:0.0:1783141763.252019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783141763.252025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000576:12345-0@lo:502: 00000100:00100000:0.0:1783141763.252094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000576:12345-0@lo:502: Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.252100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783141763.252131:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.252143:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000576:0@lo:502: 00000040:00080000:0.0:1783141763.252452:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783141763.252478:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783141763.252498:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000704:0@lo:502: 00000100:00100000:0.0:1783141763.252534:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.252558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000704 00000100:00100000:0.0:1783141763.252562:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000704 00000100:00100000:0.0:1783141763.252596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783141763.252603:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000704:12345-0@lo:502: 00000100:00100000:0.0:1783141763.252665:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000704:12345-0@lo:502: Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.252672:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783141763.252702:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.252714:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000704:0@lo:502: 00000040:00080000:0.0:1783141763.252750:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783141763.252757:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783141763.259756:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141763.259770:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141763.259779:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783141763.259787:0:9530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6f70d800 00000020:00000080:2.0:1783141763.259789:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783141763.259805:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141763.259808:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141763.259809:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783141763.259812:0:9530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783141763.261567:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783141763.261611:0:9515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141763.261638:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.261651:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.261712:0:9515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783141763.261715:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c6f70d800 10000000:01000000:0.0:1783141763.261718:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c6f70d800 10000000:01000000:0.0:1783141763.261721:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141763.261727:0:9515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c6f70d800 from 1 10000000:01000000:0.0:1783141763.261729:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141763.261764:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.261788:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.261799:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.261822:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000832:0@lo:101: 00000100:00100000:0.0:1783141763.261888:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.261933:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.262879:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000832 00000100:00100000:2.0:1783141763.262889:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000832 00000100:00100000:2.0:1783141763.262936:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783141763.262945:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9515:x1869759521000832:12345-0@lo:101: 00010000:00010000:2.0:1783141763.262959:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141763.262972:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806c91 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.262996:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.263016:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.263025:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3000, rc 0) 00000100:00100000:2.0:1783141763.263084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521000832:12345-0@lo:101: Request processed in 140us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.263091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783141763.263254:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000832:0@lo:101: 00010000:00010000:0.0:1783141763.263627:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.263638:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.263735:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000960:0@lo:501: 00000100:00100000:0.0:1783141763.263773:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.263812:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.263862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521000960 00000100:00100000:2.0:1783141763.263867:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521000960 00000100:00100000:2.0:1783141763.263901:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783141763.263908:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521000960:12345-0@lo:501: 00000100:00100000:2.0:1783141763.264023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521000960:12345-0@lo:501: Request processed in 116us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.264042:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783141763.264155:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521000960:0@lo:501: 00000100:00100000:3.0:1783141763.264184:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001088:0@lo:503: 00000100:00100000:3.0:1783141763.264235:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141763.264249:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141763.264462:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001088 00000100:00100000:3.0:1783141763.264467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001088 00000100:00100000:3.0:1783141763.264487:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783141763.264492:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001088:12345-0@lo:503: 00000100:00100000:3.0:1783141763.264588:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001088:12345-0@lo:503: Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.264601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783141763.264785:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001088:0@lo:503: 00000040:00080000:2.0:1783141763.265010:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783141763.265087:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001216:0@lo:502: 00000100:00100000:2.0:1783141763.265126:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.265161:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141763.265419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001216 00000100:00100000:3.0:1783141763.265425:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001216 00000100:00100000:3.0:1783141763.265459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783141763.265466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001216:12345-0@lo:502: 00000100:00100000:3.0:1783141763.265559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001216:12345-0@lo:502: Request processed in 94us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.265566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783141763.265739:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001216:0@lo:502: 00000040:00080000:2.0:1783141763.265915:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783141763.265941:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783141763.265957:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783141763.265970:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783141763.265985:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783141763.265997:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783141763.266022:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783141763.266035:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783141763.266048:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783141763.266133:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783141763.266153:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783141763.266168:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783141763.266180:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783141763.266192:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783141763.266407:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783141763.266427:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783141763.266440:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783141763.267082:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783141763.267105:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783141763.267120:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783141763.267133:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783141763.267147:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783141763.267161:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783141763.267177:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783141763.267191:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783141763.267217:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783141763.267233:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783141763.267246:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783141763.267260:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783141763.267303:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783141763.267330:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783141763.267348:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783141763.267363:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783141763.267377:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783141763.267390:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783141763.267405:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783141763.267417:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1783141763.267461:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783141763.267479:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1783141763.267506:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1783141763.267520:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1783141763.267533:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1783141763.267933:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1783141763.267958:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1783141763.267973:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1783141763.267987:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1783141763.268041:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001344:0@lo:502: 00000100:00100000:3.0:1783141763.268122:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141763.268168:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141763.270207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001344 00000100:00100000:0.0:1783141763.270220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001344 00000100:00100000:0.0:1783141763.270311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783141763.270620:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001344:12345-0@lo:502: 00000100:00100000:0.0:1783141763.270779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521001344:12345-0@lo:502: Request processed in 459us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.270787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141763.271312:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521001344:0@lo:502: 00000040:00080000:3.0:1783141763.271390:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1783141763.271416:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1783141763.273080:0:9532:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783141763.273103:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f9b432b99c0) 00000020:00000080:1.0:1783141763.273128:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1783141763.273356:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f70d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783141763.273361:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6f70d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783141763.273363:0:9532:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6f70d800 3 00010000:00080000:1.0:1783141763.273400:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b432c5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783141763.276932:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783141763.277047:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783141763.277097:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783141763.277111:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb31399d6a3806ca6 00000100:00080000:3.0:1783141763.277121:0:9532:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141763.277127:0:9532:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f9b432c5800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783141763.277162:0:9532:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c7630a300 x1869759521001472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783141763.277190:0:9532:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783141763.277981:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521001472:0@lo:38: 00000100:00100000:1.0:1783141763.278090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.278402:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521001984:0@lo:400: 00000100:00100000:0.0:1783141763.278432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.278603:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521001856:0@lo:400: 00000100:00100000:2.0:1783141763.278634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.278652:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521002368:0@lo:400: 00000100:00100000:2.0:1783141763.278674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.278714:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141763.278721:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521001728:0@lo:400: 00000100:00100000:2.0:1783141763.278742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.278756:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521002240:0@lo:400: 00000100:00100000:2.0:1783141763.278775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.278964:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001472 00000100:00100000:2.0:1783141763.278972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001472 00000100:00100000:2.0:1783141763.279013:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001856 00000100:00100000:2.0:1783141763.279016:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001856 00000100:00100000:2.0:1783141763.279040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002240 00000100:00100000:2.0:1783141763.279043:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002240 00000100:00100000:2.0:1783141763.279082:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141763.279090:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521001856:12345-0@lo:400: 00000100:00100000:2.0:1783141763.279141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521001856:12345-0@lo:400: Request processed in 52us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.279147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141763.279162:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141763.279168:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521002240:12345-0@lo:400: 00000100:00100000:2.0:1783141763.279193:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521002240:12345-0@lo:400: Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.279197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141763.279221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141763.279226:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759521001472:12345-0@lo:38: 00010000:00080000:2.0:1783141763.279246:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1783141763.279308:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb31399d6a3806cad 00000004:00100000:2.0:1783141763.279322:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783141763.279352:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141763.279400:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759521001472:12345-0@lo:38: Request processed in 173us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.279406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141763.279428:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002368 00000100:00100000:2.0:1783141763.279432:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002368 00000100:00100000:0.0:1783141763.279911:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521002496:0@lo:400: 00000100:00100000:0.0:1783141763.279942:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.279966:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783141763.279972:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521001600:0@lo:400: 00000100:00100000:0.0:1783141763.279995:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.280023:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521002112:0@lo:400: 00000100:00100000:0.0:1783141763.280044:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.280264:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002496 00000100:00100000:0.0:1783141763.281526:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001984 00000100:00100000:0.0:1783141763.281534:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001984 00000100:00100000:2.0:1783141763.281630:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002496 00000100:00100000:2.0:1783141763.281683:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141763.281692:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521002368:12345-0@lo:400: 00000100:00100000:2.0:1783141763.281757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521002368:12345-0@lo:400: Request processed in 67us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.281764:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141763.281779:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141763.281784:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521002496:12345-0@lo:400: 00000100:00100000:2.0:1783141763.281818:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521002496:12345-0@lo:400: Request processed in 34us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.281823:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141763.281841:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001728 00000100:00100000:2.0:1783141763.281844:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001728 00000100:00100000:2.0:1783141763.281869:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783141763.281874:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521001728:12345-0@lo:400: 00000100:00100000:2.0:1783141763.281907:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521001728:12345-0@lo:400: Request processed in 32us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.281912:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783141763.281930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521001600 00000100:00100000:2.0:1783141763.281933:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521001600 00000100:00100000:2.0:1783141763.281948:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002112 00000100:00100000:2.0:1783141763.281951:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002112 00000100:00100000:2.0:1783141763.281980:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141763.281986:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521001600:12345-0@lo:400: 00000100:00100000:2.0:1783141763.282027:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521001600:12345-0@lo:400: Request processed in 42us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.282033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141763.282043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141763.282048:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521002112:12345-0@lo:400: 00000100:00100000:0.0:1783141763.282150:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783141763.282157:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521001984:12345-0@lo:400: 00000100:00100000:0.0:1783141763.282193:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521001984:12345-0@lo:400: Request processed in 37us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.282382:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:01000004:0.0:1783141763.286199:0:9532:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783141763.286216:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f9b43014d40) 00000020:00000080:0.0:1783141763.286240:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1783141763.286411:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f70d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783141763.286415:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6f70d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783141763.286418:0:9532:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6f70d800 3 00010000:00080000:0.0:1783141763.286444:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b4302d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.139@tcp at head 00000100:00100000:2.0:1783141763.288974:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521002112:12345-0@lo:400: Request processed in 6917us (8920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.288988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783141763.289038:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141763.289044:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141763.289046:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141763.289083:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521001728:0@lo:400: 00010000:00080000:2.0:1783141763.289098:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dc700 x1869759521002240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289107:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521002240:0@lo:400: 00010000:00080000:2.0:1783141763.289119:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6ddc00 x1869759521001856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289127:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521001856:0@lo:400: 00010000:00080000:2.0:1783141763.289138:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6de680 x1869759521002368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289146:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521002368:0@lo:400: 00010000:00080000:2.0:1783141763.289304:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dd180 x1869759521001600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289330:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521001600:0@lo:400: 00010000:00080000:2.0:1783141763.289343:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dca80 x1869759521002112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289351:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521002112:0@lo:400: 00000100:00100000:2.0:1783141763.289362:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521001984:0@lo:400: 00010000:00080000:2.0:1783141763.289373:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dc000 x1869759521002496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289380:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521002496:0@lo:400: 00010000:00080000:2.0:1783141763.289424:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7630a300 x1869759521001472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.289432:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141763.289439:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783141763.289447:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783141763.289452:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783141763.289456:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783141763.289463:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521001472:0@lo:38: 00010000:00010000:0.0:1783141763.294756:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1783141763.294857:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783141763.294918:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783141763.294931:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb31399d6a3806cbb 00000100:00080000:0.0:1783141763.294942:0:9532:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141763.294954:0:9532:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f9b4302d000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141763.294990:0:9532:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c7b6dc000 x1869759521002624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783141763.295024:0:9532:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783141763.297985:0:9533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1869759521002752:0@lo:901: 00000100:00100000:0.0:1783141763.302206:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.302289:0:9533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141763.304107:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521002624:0@lo:38: 00000100:00100000:2.0:1783141763.304203:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.304359:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002624 00000100:00100000:0.0:1783141763.304367:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002624 00000100:00100000:0.0:1783141763.304410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141763.304418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759521002624:12345-0@lo:38: 00010000:00080000:0.0:1783141763.304659:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1783141763.304707:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb31399d6a3806cc2 00000004:00100000:0.0:1783141763.304723:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783141763.304755:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141763.304809:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759521002624:12345-0@lo:38: Request processed in 390us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.304818:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783141763.304896:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dc000 x1869759521002624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.304907:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141763.304914:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783141763.304927:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783141763.304931:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783141763.304934:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783141763.304940:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521002624:0@lo:38: 00000100:00100000:2.0:1783141763.306340:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002752 00000100:00100000:2.0:1783141763.306351:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002752 00000100:00100000:2.0:1783141763.306408:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141763.306416:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1869759521002752:12345-0@lo:901: 00000100:00100000:2.0:1783141763.306683:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1869759521002752:12345-0@lo:901: Request processed in 266us (8616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141763.306690:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783141763.306711:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783141763.306743:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c7b6dd500 x1869759521002752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783141779 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141763.306757:0:9533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1869759521002752:0@lo:901: 00000040:00080000:1.0:1783141763.309250:0:9532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1783141763.309413:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1783141763.309440:0:9515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783141763.309474:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.309487:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783141763.309541:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783141763.309543:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783141763.309696:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141763.309698:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141763.309699:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141763.309707:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141763.309708:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141763.309709:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141763.309710:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141763.309712:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141763.309713:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141763.309716:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1783141763.309718:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141763.309720:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783141763.309721:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141763.309722:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141763.309723:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141763.309724:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141763.309724:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141763.309725:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141763.309726:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141763.309727:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141763.309728:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141763.309753:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783141763.309771:0:9515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521002880:0@lo:253: 00000100:00100000:2.0:1783141763.309832:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.309874:0:9515:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783141763.309921:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521002880 00000100:00100000:1.0:1783141763.309928:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521002880 00000100:00100000:1.0:1783141763.309975:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783141763.309984:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521002880:12345-0@lo:253: 20000000:01000000:1.0:1783141763.310022:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783141763.310035:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783141763.314760:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783141763.314777:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783141763.315255:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783141763.315260:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783141763.315309:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315327:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315335:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315342:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315389:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315403:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 17 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.315416:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759521003008:0@lo:104: 00000100:00100000:2.0:1783141763.315505:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141763.315667:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141763.315676:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 17 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141763.315686:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759521003136:0@lo:104: 00000100:00100000:2.0:1783141763.315711:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141763.315730:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762ef240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141763.315844:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003008 00000100:00100000:1.0:1783141763.315852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003008 00000100:00100000:1.0:1783141763.315890:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003136 00000100:00100000:1.0:1783141763.315893:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003136 00000100:00100000:1.0:1783141763.315906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783141763.315914:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759521003008:12345-0@lo:104: 00010000:00010000:1.0:1783141763.315926:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.315976:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141763.315982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:6538:x1869759521003008:12345-0@lo:104: Request processed in 69us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.315989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783141763.316014:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783141763.316028:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759521003136:12345-0@lo:104: 00010000:00010000:1.0:1783141763.316036:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141763.316069:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783141763.316074:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:6538:x1869759521003136:12345-0@lo:104: Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.316080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141763.316343:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759521003008:0@lo:104: 00000100:00100000:3.0:1783141763.316353:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869759521003136:0@lo:104: 00010000:00010000:3.0:1783141763.316372:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.316498:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9515:x1869759521002880:12345-0@lo:253: Request processed in 6514us (6665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.316507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:0.0:1783141763.316536:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141763.316541:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316559:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.316563:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316588:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.316594:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.316600:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.316629:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316635:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.316653:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316660:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031600/0xb31399d6a3806bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316670:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141763.316674:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316679:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141763.316682:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316689:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141763.316694:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141763.316706:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141763.316720:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316726:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141763.316741:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316747:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806bbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.316759:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.316760:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.316761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.316767:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141763.316776:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521003264:0@lo:103: 00000100:00100000:0.0:1783141763.316804:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.316848:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521003392:0@lo:103: 00000100:00100000:0.0:1783141763.316870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141763.316898:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003264 00000100:00100000:0.0:1783141763.316902:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003264 00010000:00010000:0.0:1783141763.316920:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 17 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.316938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003392 00000100:00100000:0.0:1783141763.316940:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003392 00010000:00010000:0.0:1783141763.316950:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 18 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.316979:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141763.316986:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:3655:x1869759521003264:12345-0@lo:103: 00010000:00010000:0.0:1783141763.317007:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141763.317013:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 18 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317022:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 18 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317036:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806bfe expref: 18 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317048:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141763.317076:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:3655:x1869759521003264:12345-0@lo:103: Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.317082:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141763.317094:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783141763.317100:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3652:x1869759521003392:12345-0@lo:103: 00010000:00010000:0.0:1783141763.317108:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141763.317112:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 16 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317120:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 16 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317130:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3a00/0xb31399d6a3806bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806bb8 expref: 16 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317151:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317159:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783141763.317171:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018884896s 00010000:00010000:0.0:1783141763.317176:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317182:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317189:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317195:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317200:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141763.317204:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317211:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317225:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317233:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141763.317263:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3652:x1869759521003392:12345-0@lo:103: Request processed in 163us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141763.317307:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1783141763.317334:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317342:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141763.317348:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3c00/0xb31399d6a3806cc9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141763.317374:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521003392:0@lo:103: 00000100:00100000:0.0:1783141763.317408:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521003264:0@lo:103: 00000100:00100000:3.0:1783141763.317615:0:9515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9515:1869759521002880:0@lo:253: 10000000:01000000:3.0:1783141763.317631:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783141763.317634:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141763.317636:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141763.317637:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141763.317638:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141763.317639:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141763.317641:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141763.317642:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141763.317643:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141763.317645:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141763.317646:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141763.317647:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783141763.317659:0:9515:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783141763.324248:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783141763.324946:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783141763.325181:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783141763.325373:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783141763.326785:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783141763.326984:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1783141763.328786:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783141763.337944:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141763.337970:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521003520:0@lo:41: 00000100:00100000:1.0:1783141763.338049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141763.338859:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003520 00000100:00100000:3.0:1783141763.338868:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003520 00000100:00100000:3.0:1783141763.338922:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141763.338932:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521003520:12345-0@lo:41: 00000004:00000024:3.0:1783141763.338966:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783141763.339031:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521003520:12345-0@lo:41: Request processed in 101us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141763.339038:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783141763.339118:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521003520:0@lo:41: 00002000:00080000:3.0:1783141763.348950:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783141763.348958:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783141763.348991:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783141763.349043:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783141763.349060:0:9515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783141763.349102:0:9515:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783141763.351908:0:9515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783141763.352141:0:9515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1783141763.850770:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141763.850797:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521003648:0@lo:13: 00000100:00100000:3.0:1783141763.851196:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141763.851658:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003648 00000100:00100000:1.0:1783141763.851668:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003648 00000100:00100000:1.0:1783141763.851834:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141763.851845:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521003648:12345-0@lo:13: 00002000:00000024:1.0:1783141763.851901:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141763.851960:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521003648:12345-0@lo:13: Request processed in 118us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141763.851967:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783141763.852784:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f766300 x1869759521003648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141763.852807:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521003648:0@lo:13: 00010000:00010000:2.0:1783141763.973689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141764.357361:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141764.357388:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521003776:0@lo:13: 00000100:00100000:3.0:1783141764.357467:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141764.357540:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003776 00000100:00100000:3.0:1783141764.357548:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003776 00000100:00100000:3.0:1783141764.357591:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141764.357599:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521003776:12345-0@lo:13: 00002000:00000024:3.0:1783141764.357620:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141764.357662:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521003776:12345-0@lo:13: Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141764.357669:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783141764.357708:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76308000 x1869759521003776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141764.357725:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521003776:0@lo:13: 00000020:00000004:2.0:1783141764.422079:0:9588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141764.422359:0:9588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141765.000546:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141766.022403:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141767.044482:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141767.428778:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521003904:0@lo:41: 00000100:00100000:1.0:1783141767.428841:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141767.429012:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521003904 00000100:00100000:2.0:1783141767.429020:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521003904 00000100:00100000:2.0:1783141767.429060:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141767.429068:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521003904:12345-0@lo:41: 00000004:00000024:2.0:1783141767.429097:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783141767.429149:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521003904:12345-0@lo:41: Request processed in 81us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141767.429163:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783141767.429244:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521003904:0@lo:41: 00010000:00010000:3.0:1783141768.069849:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141768.452503:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521004032:0@lo:400: 00000100:00100000:1.0:1783141768.452552:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521004416:0@lo:400: 00000100:00100000:0.0:1783141768.452593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141768.452597:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141768.452663:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521004544:0@lo:400: 00000100:00100000:0.0:1783141768.452690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141768.452707:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521005056:0@lo:400: 00000100:00100000:0.0:1783141768.452727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141768.452756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004032 00000100:00100000:0.0:1783141768.452762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004032 00000100:00100000:0.0:1783141768.452804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783141768.452813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3653:x1869759521004032:12345-0@lo:400: 00000100:00100000:3.0:1783141768.452822:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521004160:0@lo:400: 00000100:00100000:0.0:1783141768.452861:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3653:x1869759521004032:12345-0@lo:400: Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141768.452863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141768.452873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783141768.452890:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521004672:0@lo:400: 00000100:00100000:0.0:1783141768.452919:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004544 00000100:00100000:3.0:1783141768.452920:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141768.452925:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004544 00000100:00100000:0.0:1783141768.452977:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783141768.452983:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521004544:12345-0@lo:400: 00000100:00100000:0.0:1783141768.453018:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521004544:12345-0@lo:400: Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141768.453024:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783141768.453041:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005056 00000100:00100000:0.0:1783141768.453044:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005056 00000100:00100000:0.0:1783141768.453083:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141768.453089:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521005056:12345-0@lo:400: 00000100:00100000:3.0:1783141768.456849:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521005184:0@lo:400: 00000100:00100000:3.0:1783141768.456914:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141768.457545:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783141768.457554:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521004288:0@lo:400: 00000100:00100000:3.0:1783141768.457586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141768.457604:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521004800:0@lo:400: 00000100:00100000:3.0:1783141768.457622:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141768.457632:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521005312:0@lo:400: 00000100:00100000:3.0:1783141768.457652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141768.457686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004416 00000100:00100000:3.0:1783141768.458005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004416 00000100:00100000:3.0:1783141768.458045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004160 00000100:00100000:3.0:1783141768.458236:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004160 00000100:00100000:3.0:1783141768.458258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004672 00000100:00100000:3.0:1783141768.458261:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004672 00000100:00100000:3.0:1783141768.458298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005184 00000100:00100000:3.0:1783141768.458301:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005184 00000100:00100000:1.0:1783141768.458427:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521004928:0@lo:400: 00000100:00100000:1.0:1783141768.458469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141768.458501:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521005440:0@lo:41: 00000100:00100000:1.0:1783141768.458524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141768.458575:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004800 00000100:00100000:1.0:1783141768.458580:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004800 00000100:00100000:1.0:1783141768.458602:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005312 00000100:00100000:1.0:1783141768.458605:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005312 00000100:00100000:1.0:1783141768.458621:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141768.458629:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521004416:12345-0@lo:400: 00000100:00100000:1.0:1783141768.458680:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521004416:12345-0@lo:400: Request processed in 52us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.458686:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141768.458704:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141768.458710:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521004160:12345-0@lo:400: 00000100:00100000:1.0:1783141768.458743:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521004160:12345-0@lo:400: Request processed in 33us (5881us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.458748:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141768.458761:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141768.458767:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521004672:12345-0@lo:400: 00000100:00100000:3.0:1783141768.458784:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783141768.458794:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521004800:12345-0@lo:400: 00000100:00100000:1.0:1783141768.458802:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521004672:12345-0@lo:400: Request processed in 32us (5879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.458809:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141768.458837:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783141768.458844:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521004800:12345-0@lo:400: Request processed in 51us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.458846:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521005312:12345-0@lo:400: 00000100:00100000:3.0:1783141768.458856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783141768.458873:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141768.458882:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521005184:12345-0@lo:400: 00000100:00100000:1.0:1783141768.458888:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521005312:12345-0@lo:400: Request processed in 44us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.458895:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783141768.458919:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004928 00000100:00100000:1.0:1783141768.458924:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004928 00000100:00100000:1.0:1783141768.458950:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141768.458957:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521004928:12345-0@lo:400: 00000100:00100000:3.0:1783141768.459001:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521005184:12345-0@lo:400: Request processed in 41us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141768.459010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141768.459036:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521004288 00000100:00100000:3.0:1783141768.459040:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521004288 00000100:00100000:3.0:1783141768.459250:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005440 00000100:00100000:3.0:1783141768.459254:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005440 00000100:00100000:3.0:1783141768.459299:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783141768.459306:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521004288:12345-0@lo:400: 00000100:00100000:3.0:1783141768.459810:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521004288:12345-0@lo:400: Request processed in 503us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141768.459818:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783141768.459835:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783141768.459842:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521005440:12345-0@lo:41: 00000004:00000024:3.0:1783141768.459866:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783141768.459895:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521005440:12345-0@lo:41: Request processed in 54us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141768.459900:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783141768.460136:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521004288:0@lo:400: 00010000:00080000:3.0:1783141768.460152:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767480 x1869759521004800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141768.460181:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521004928:12345-0@lo:400: Request processed in 1219us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.460189:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141768.460501:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521004800:0@lo:400: 00010000:00080000:3.0:1783141768.460522:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765880 x1869759521005312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141768.460532:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521005312:0@lo:400: 00010000:00080000:3.0:1783141768.460542:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765500 x1869759521004160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141768.460550:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521004160:0@lo:400: 00010000:00080000:3.0:1783141768.460561:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764000 x1869759521004672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141768.460570:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521004672:0@lo:400: 00010000:00080000:3.0:1783141768.460597:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765f80 x1869759521005184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141768.460606:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521005184:0@lo:400: 00000100:00100000:3.0:1783141768.460658:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521004544:0@lo:400: 00000100:00100000:3.0:1783141768.461013:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521004032:0@lo:400: 00000100:00080000:2.0:1783141768.461704:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141768.461710:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141768.461714:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141768.462933:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521005440:0@lo:41: 00010000:00080000:1.0:1783141768.462954:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764700 x1869759521004416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141768.463315:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521004416:0@lo:400: 00010000:00080000:1.0:1783141768.463331:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767100 x1869759521004928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141768.463341:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521004928:0@lo:400: 00000100:00100000:0.0:1783141768.467094:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521005056:12345-0@lo:400: Request processed in 13995us (14355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141768.468457:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783141768.470323:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767800 x1869759521005056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141768.470343:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521005056:0@lo:400: 00000100:00100000:0.0:1783141768.965143:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141768.965170:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521005568:0@lo:13: 00000100:00100000:0.0:1783141768.965237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141768.965375:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005568 00000100:00100000:1.0:1783141768.965383:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005568 00000100:00100000:1.0:1783141768.965437:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141768.965447:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521005568:12345-0@lo:13: 00002000:00000024:1.0:1783141768.965481:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141768.965530:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521005568:12345-0@lo:13: Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141768.965549:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783141768.965687:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767100 x1869759521005568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141768.965705:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521005568:0@lo:13: 00010000:00010000:2.0:1783141769.092543:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141769.486024:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521005696:0@lo:13: 00000100:00100000:2.0:1783141769.486094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141769.486218:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005696 00000100:00100000:0.0:1783141769.486226:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005696 00000100:00100000:0.0:1783141769.486290:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783141769.486299:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521005696:12345-0@lo:13: 00002000:00000024:0.0:1783141769.486328:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141769.486371:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521005696:12345-0@lo:13: Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141769.486392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783141769.486433:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dd500 x1869759521005696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141769.486450:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521005696:0@lo:13: 00010000:00010000:2.0:1783141770.117579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141771.131960:0:9878:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141771.146112:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141772.164699:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783141772.269181:0:9930:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141772.274015:0:9930:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783141772.558570:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521005824:0@lo:41: 00000100:00100000:1.0:1783141772.558636:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141772.558708:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005824 00000100:00100000:1.0:1783141772.558715:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005824 00000100:00100000:1.0:1783141772.558758:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141772.558766:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521005824:12345-0@lo:41: 00000004:00000024:1.0:1783141772.558799:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783141772.558839:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521005824:12345-0@lo:41: Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141772.558846:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141772.558883:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521005824:0@lo:41: 10000000:01000000:3.0:1783141773.061499:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141773.061506:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b728800 from 39 10000000:01000000:3.0:1783141773.061512:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141773.061556:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.061569:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.061580:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.061602:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521005952:0@lo:101: 00000100:00100000:3.0:1783141773.061669:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.061744:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141773.061758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521005952 00000100:00100000:0.0:1783141773.061769:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521005952 00000100:00100000:0.0:1783141773.061823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783141773.061832:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759521005952:12345-0@lo:101: 00010000:00010000:0.0:1783141773.061845:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141773.061858:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806cd0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141773.061880:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141773.061891:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141773.061900:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40030e00, rc 0) 00000100:00100000:0.0:1783141773.061960:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521005952:12345-0@lo:101: Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141773.061966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783141773.063679:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521005952:0@lo:101: 00010000:00010000:3.0:1783141773.063705:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.063718:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.063817:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006080:0@lo:501: 00000100:00100000:3.0:1783141773.063873:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.063918:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.063964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006080 00000100:00100000:2.0:1783141773.063972:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006080 00000100:00100000:2.0:1783141773.064019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783141773.064030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521006080:12345-0@lo:501: 00000100:00100000:2.0:1783141773.064176:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521006080:12345-0@lo:501: Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.064185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783141773.064598:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006080:0@lo:501: 00000100:00100000:3.0:1783141773.064630:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006208:0@lo:503: 00000100:00100000:3.0:1783141773.064674:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.064764:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.064810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006208 00000100:00100000:2.0:1783141773.064814:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006208 00000100:00100000:2.0:1783141773.064882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141773.064895:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521006208:12345-0@lo:503: 00000100:00100000:2.0:1783141773.064990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521006208:12345-0@lo:503: Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.065005:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783141773.065062:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006208:0@lo:503: 00000100:00100000:3.0:1783141773.065245:0:9961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9961:1869759521006336:0@lo:502: 00000100:00100000:3.0:1783141773.065306:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.065321:0:9961:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.065375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006336 00000100:00100000:2.0:1783141773.065445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006336 00000100:00100000:2.0:1783141773.065473:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783141773.065550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9961:x1869759521006336:12345-0@lo:502: 00000100:00100000:2.0:1783141773.065625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9961:x1869759521006336:12345-0@lo:502: Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.065633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783141773.065727:0:9961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9961:1869759521006336:0@lo:502: 00000100:00100000:3.0:1783141773.065768:0:9961:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9961:1869759521006464:0@lo:502: 00000100:00100000:3.0:1783141773.065800:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.065863:0:9961:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.065899:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006464 00000100:00100000:2.0:1783141773.065904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006464 00000100:00100000:2.0:1783141773.065974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783141773.065982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9961:x1869759521006464:12345-0@lo:502: 00000100:00100000:2.0:1783141773.066047:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:9961:x1869759521006464:12345-0@lo:502: Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.066055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783141773.066117:0:9961:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9961:1869759521006464:0@lo:502: 00000040:00080000:3.0:1783141773.066136:0:9961:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1783141773.066196:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1783141773.066214:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141773.066224:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.066234:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141773.066252:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783141773.066255:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1783141773.066258:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141773.066297:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.066306:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.066315:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.066328:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006592:0@lo:101: 00000100:00100000:3.0:1783141773.066358:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.066373:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.066469:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006592 00000100:00100000:2.0:1783141773.066473:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006592 00000100:00100000:2.0:1783141773.066567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783141773.066573:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521006592:12345-0@lo:101: 00010000:00010000:2.0:1783141773.066582:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141773.066594:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806cde expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141773.066615:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806cde expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141773.066624:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cde expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141773.066640:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2a00, rc 0) 00000100:00100000:2.0:1783141773.066668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521006592:12345-0@lo:101: Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.066673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783141773.066848:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006592:0@lo:101: 00010000:00010000:2.0:1783141773.066860:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141773.066869:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141773.066911:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006720:0@lo:501: 00000100:00100000:2.0:1783141773.066947:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141773.067017:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.067055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006720 00000100:00100000:3.0:1783141773.067060:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006720 00000100:00100000:2.0:1783141773.067163:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783141773.067170:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521006720:12345-0@lo:501: 00000100:00100000:2.0:1783141773.067690:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521006720:12345-0@lo:501: Request processed in 520us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.067697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783141773.067782:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006720:0@lo:501: 00000100:00100000:3.0:1783141773.067808:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006848:0@lo:503: 00000100:00100000:3.0:1783141773.067843:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.067896:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141773.067940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006848 00000100:00100000:2.0:1783141773.067945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006848 00000100:00100000:2.0:1783141773.068008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783141773.068016:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521006848:12345-0@lo:503: 00000100:00100000:2.0:1783141773.068096:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521006848:12345-0@lo:503: Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.068113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783141773.068181:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521006848:0@lo:503: 00000100:00100000:1.0:1783141773.068560:0:9963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9963:1869759521006976:0@lo:502: 00000100:00100000:1.0:1783141773.068603:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.068637:0:9963:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a4eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.068690:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521006976 00000100:00100000:3.0:1783141773.068695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521006976 00000100:00100000:3.0:1783141773.068730:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783141773.068737:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9963:x1869759521006976:12345-0@lo:502: 00000100:00100000:3.0:1783141773.068812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9963:x1869759521006976:12345-0@lo:502: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.068827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783141773.068913:0:9963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9963:1869759521006976:0@lo:502: 00000020:01000000:1.0:1783141773.068946:0:9963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141773.068955:0:9963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.068957:0:9963:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783141773.068964:0:9963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783141773.068966:0:9963:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783141773.068983:0:9963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9963:1869759521007104:0@lo:502: 00000100:00100000:1.0:1783141773.069018:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.069041:0:9963:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.069163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007104 00000100:00100000:3.0:1783141773.069168:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007104 00000100:00100000:3.0:1783141773.069198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783141773.069205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9963:x1869759521007104:12345-0@lo:502: 00000100:00100000:3.0:1783141773.069265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:9963:x1869759521007104:12345-0@lo:502: Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.069293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783141773.069372:0:9963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9963:1869759521007104:0@lo:502: 00000020:01000000:1.0:1783141773.069390:0:9963:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141773.069395:0:9963:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.069396:0:9963:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783141773.069399:0:9963:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783141773.069635:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783141773.069654:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783141773.069662:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.069671:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141773.069680:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141773.069683:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b4fc000 from 39 10000000:01000000:3.0:1783141773.069686:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141773.069709:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.069717:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.069725:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.069738:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007232:0@lo:101: 00000100:00100000:3.0:1783141773.069774:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.069806:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.069853:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007232 00000100:00100000:1.0:1783141773.069858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007232 00000100:00100000:1.0:1783141773.069888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783141773.069895:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521007232:12345-0@lo:101: 00010000:00010000:1.0:1783141773.069904:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141773.069916:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806cec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.069943:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806cec expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.069952:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cec expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.069960:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168fa00, rc 0) 00000100:00100000:1.0:1783141773.069990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007232:12345-0@lo:101: Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.069997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783141773.070072:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007232:0@lo:101: 00010000:00010000:3.0:1783141773.070084:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.070094:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.070140:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007360:0@lo:501: 00000100:00100000:3.0:1783141773.070167:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.070188:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.070236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007360 00000100:00100000:1.0:1783141773.070240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007360 00000100:00100000:1.0:1783141773.070298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783141773.070307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007360:12345-0@lo:501: 00000100:00100000:1.0:1783141773.070570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007360:12345-0@lo:501: Request processed in 263us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.070587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141773.070661:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007360:0@lo:501: 00000100:00100000:3.0:1783141773.070688:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007488:0@lo:503: 00000100:00100000:3.0:1783141773.070722:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.070750:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.070793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007488 00000100:00100000:1.0:1783141773.070797:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007488 00000100:00100000:1.0:1783141773.070826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783141773.070833:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007488:12345-0@lo:503: 00000100:00100000:1.0:1783141773.070907:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007488:12345-0@lo:503: Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.070914:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783141773.070996:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007488:0@lo:503: 00000100:00100000:3.0:1783141773.071622:0:9964:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9964:1869759521007616:0@lo:502: 00000100:00100000:3.0:1783141773.071661:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.071720:0:9964:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.071755:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007616 00000100:00100000:1.0:1783141773.071760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007616 00000100:00100000:1.0:1783141773.071826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783141773.071834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:9964:x1869759521007616:12345-0@lo:502: 00000100:00100000:1.0:1783141773.071971:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:9964:x1869759521007616:12345-0@lo:502: Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.071979:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783141773.072063:0:9964:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9964:1869759521007616:0@lo:502: 00000100:00100000:2.0:1783141773.072109:0:9964:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9964:1869759521007744:0@lo:502: 00000100:00100000:2.0:1783141773.072146:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141773.072206:0:9964:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.072237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007744 00000100:00100000:1.0:1783141773.072241:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007744 00000100:00100000:1.0:1783141773.072327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783141773.072335:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:9964:x1869759521007744:12345-0@lo:502: 00000100:00100000:1.0:1783141773.072421:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:9964:x1869759521007744:12345-0@lo:502: Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.072427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783141773.072616:0:9964:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9964:1869759521007744:0@lo:502: 00000040:00080000:2.0:1783141773.072637:0:9964:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783141773.072775:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783141773.072794:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783141773.072803:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.072824:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141773.072833:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783141773.072836:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c7b4fc000 from 6 10000000:01000000:1.0:1783141773.072838:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783141773.072866:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.072876:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.072884:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.072899:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007872:0@lo:101: 00000100:00100000:1.0:1783141773.072946:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.073014:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.073071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521007872 00000100:00100000:3.0:1783141773.073076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521007872 00000100:00100000:3.0:1783141773.073112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783141773.073120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521007872:12345-0@lo:101: 00010000:00010000:3.0:1783141773.073130:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141773.073144:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a2600/0xb31399d6a3806d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806cfa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.073172:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a2600/0xb31399d6a3806d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806cfa expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.073181:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a2600/0xb31399d6a3806d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cfa expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.073190:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2600, rc 0) 00000100:00100000:3.0:1783141773.073222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521007872:12345-0@lo:101: Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.073229:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783141773.073261:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521007872:0@lo:101: 00010000:00010000:3.0:1783141773.073290:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.073300:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.073346:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008000:0@lo:256: 00000100:00100000:3.0:1783141773.073389:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.073403:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.073414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008000 00000100:00100000:3.0:1783141773.073418:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008000 00000100:00100000:3.0:1783141773.073436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783141773.073441:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521008000:12345-0@lo:256: 20000000:01000000:3.0:1783141773.073453:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141773.073468:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141773.073471:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1783141773.073725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521008000:12345-0@lo:256: Request processed in 282us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.073732:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783141773.073801:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008000:0@lo:256: 10000000:01000000:1.0:1783141773.073843:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141773.073849:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.073856:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141773.073863:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783141773.073865:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1783141773.073874:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783141773.073893:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.073900:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.073908:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.073920:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008128:0@lo:101: 00000100:00100000:1.0:1783141773.073957:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.073986:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.074036:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008128 00000100:00100000:3.0:1783141773.074040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008128 00000100:00100000:3.0:1783141773.074072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783141773.074080:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521008128:12345-0@lo:101: 00010000:00010000:3.0:1783141773.074087:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141773.074096:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806d08 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.074112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.074120:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.074127:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:3.0:1783141773.074160:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521008128:12345-0@lo:101: Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.074165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783141773.074193:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008128:0@lo:101: 00010000:00010000:3.0:1783141773.074202:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.074210:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.074255:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008256:0@lo:501: 00000100:00100000:3.0:1783141773.074313:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.074333:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.074344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008256 00000100:00100000:3.0:1783141773.074348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008256 00000100:00100000:3.0:1783141773.074369:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783141773.074374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521008256:12345-0@lo:501: 00000100:00100000:3.0:1783141773.074670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521008256:12345-0@lo:501: Request processed in 295us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.074677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783141773.074743:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008256:0@lo:501: 00000100:00100000:1.0:1783141773.074770:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008384:0@lo:503: 00000100:00100000:1.0:1783141773.074807:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.074828:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.074875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008384 00000100:00100000:3.0:1783141773.074880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008384 00000100:00100000:3.0:1783141773.074913:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783141773.074921:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521008384:12345-0@lo:503: 00000100:00100000:3.0:1783141773.075014:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521008384:12345-0@lo:503: Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.075021:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783141773.075067:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521008384:0@lo:503: 00000100:00100000:3.0:1783141773.075258:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9966:1869759521008512:0@lo:502: 00000100:00100000:3.0:1783141773.075318:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.075338:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008512 00000100:00100000:3.0:1783141773.075342:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008512 00000100:00100000:3.0:1783141773.075360:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783141773.075367:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:9966:x1869759521008512:12345-0@lo:502: 00000100:00100000:3.0:1783141773.075674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:9966:x1869759521008512:12345-0@lo:502: Request processed in 246us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.075682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783141773.075724:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.075736:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9966:1869759521008512:0@lo:502: 00000020:01000000:3.0:1783141773.075757:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783141773.075764:0:9966:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783141773.075770:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141773.075773:0:9966:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783141773.075777:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783141773.075780:0:9966:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:3.0:1783141773.075800:0:9966:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783141773.075803:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783141773.075817:0:9966:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f9b42304d40) 00000020:00000080:3.0:1783141773.075835:0:9966:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783141773.075841:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783141773.075920:0:9966:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783141773.075927:0:9966:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783141773.075946:0:9966:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3806d1d 00010000:00080000:3.0:1783141773.075979:0:9966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c7dffc800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783141773.076236:0:9966:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1783141773.076647:0:9966:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783141773.076659:0:9966:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783141773.076813:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141773.076959:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141773.077112:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783141773.077212:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783141773.077708:0:9967:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141773.077714:0:9967:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783141773.078843:0:9966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141773.079822:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783141773.079878:0:9966:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783141773.079904:0:9966:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806d24 00000100:00080000:2.0:1783141773.079916:0:9966:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141773.079921:0:9966:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9c7dffc800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141773.079964:0:9966:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43516680 x1869759521008640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141773.080023:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521008640:0@lo:8: 00000100:00100000:3.0:1783141773.080092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.080179:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008640 00000100:00100000:1.0:1783141773.080186:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008640 00000100:00100000:1.0:1783141773.080217:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141773.080224:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521008640:12345-0@lo:8: 00010000:00080000:1.0:1783141773.080248:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:1.0:1783141773.080299:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3806d2b 00002000:00100000:1.0:1783141773.080312:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f9b432c2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1783141773.080316:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1783141773.080320:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783141773.080374:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783141773.080634:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1783141773.080658:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c1800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783141773.080921:0:9966:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783141773.081003:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141773.081008:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141773.081010:0:9966:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783141773.081014:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141773.081017:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141773.081018:0:9966:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783141773.081021:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783141773.081023:0:9966:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783141773.081048:0:9966:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9966:1869759521008768:0@lo:502: 00000100:00100000:2.0:1783141773.081092:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141773.081122:0:9966:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b421c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.081954:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759521008640:12345-0@lo:8: Request processed in 1726us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.081967:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141773.082106:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521009152:0@lo:400: 00000100:00100000:1.0:1783141773.082144:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.082167:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521009664:0@lo:400: 00000100:00100000:1.0:1783141773.082214:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.082237:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783141773.082243:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521009280:0@lo:400: 00000100:00100000:1.0:1783141773.082268:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.082301:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521009792:0@lo:400: 00000100:00100000:1.0:1783141773.082321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.082358:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009152 00000100:00100000:1.0:1783141773.082364:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009152 00000100:00100000:1.0:1783141773.082471:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141773.082543:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521009152:12345-0@lo:400: 00000100:00100000:1.0:1783141773.082593:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521009152:12345-0@lo:400: Request processed in 113us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.082600:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141773.082623:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009664 00000100:00100000:1.0:1783141773.082626:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009664 00000100:00100000:1.0:1783141773.082658:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009792 00000100:00100000:1.0:1783141773.082661:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009792 00000100:00100000:1.0:1783141773.082680:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141773.082686:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521009664:12345-0@lo:400: 00000100:00100000:1.0:1783141773.082726:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521009664:12345-0@lo:400: Request processed in 40us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.082738:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141773.082749:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141773.082755:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521009792:12345-0@lo:400: 00000100:00100000:1.0:1783141773.082782:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521009792:12345-0@lo:400: Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.082787:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141773.082803:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009280 00000100:00100000:1.0:1783141773.082807:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009280 00000100:00100000:1.0:1783141773.082830:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783141773.082837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521009280:12345-0@lo:400: 00000100:00100000:1.0:1783141773.082869:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521009280:12345-0@lo:400: Request processed in 32us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.082875:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1783141773.082898:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141773.082945:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521009280:0@lo:400: 00010000:00080000:1.0:1783141773.082962:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767480 x1869759521009792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141773.082972:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521009792:0@lo:400: 00010000:00080000:1.0:1783141773.082984:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f766680 x1869759521009152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141773.082993:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521009152:0@lo:400: 00010000:00080000:1.0:1783141773.083006:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765880 x1869759521009664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141773.083015:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521009664:0@lo:400: 00000100:00100000:1.0:1783141773.083065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008768 00000100:00100000:1.0:1783141773.083069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008768 00000100:00100000:1.0:1783141773.083093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783141773.083100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:9966:x1869759521008768:12345-0@lo:502: 00000100:00100000:1.0:1783141773.083212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:9966:x1869759521008768:12345-0@lo:502: Request processed in 112us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.083218:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783141773.083261:0:9966:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9966:1869759521008768:0@lo:502: 00000020:01000000:1.0:1783141773.083336:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141773.083342:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.083344:0:9966:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783141773.083349:0:9966:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1783141773.083694:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521008896:0@lo:400: 00000100:00100000:3.0:1783141773.083730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.083771:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521009408:0@lo:400: 00000100:00100000:3.0:1783141773.083798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.083816:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521009920:0@lo:400: 00000100:00100000:3.0:1783141773.083840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.083859:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783141773.083865:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521009024:0@lo:400: 00000100:00100000:3.0:1783141773.083891:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.083923:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521009536:0@lo:400: 00000100:00100000:3.0:1783141773.083955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.083966:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521010048:0@lo:400: 00000100:00100000:3.0:1783141773.083992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.084017:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521008896 00000100:00100000:3.0:1783141773.084021:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521008896 00000100:00100000:3.0:1783141773.084045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009408 00000100:00100000:3.0:1783141773.084048:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009408 00000100:00100000:3.0:1783141773.084071:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009920 00000100:00100000:3.0:1783141773.084074:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009920 00000100:00100000:3.0:1783141773.084090:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009536 00000100:00100000:3.0:1783141773.084092:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009536 00000100:00100000:3.0:1783141773.084106:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010048 00000100:00100000:3.0:1783141773.084109:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010048 00000100:00100000:3.0:1783141773.084127:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141773.084134:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521008896:12345-0@lo:400: 00000100:00100000:3.0:1783141773.084178:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521008896:12345-0@lo:400: Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.084463:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141773.084611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783141773.084620:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521009408:12345-0@lo:400: 00000100:00100000:3.0:1783141773.084663:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521009408:12345-0@lo:400: Request processed in 45us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.084669:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783141773.084680:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141773.084686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521009920:12345-0@lo:400: 00000100:00100000:3.0:1783141773.084714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521009920:12345-0@lo:400: Request processed in 29us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.084719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141773.084731:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783141773.084737:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521009536:12345-0@lo:400: 00000100:00100000:3.0:1783141773.084766:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521009536:12345-0@lo:400: Request processed in 29us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.084771:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783141773.084782:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783141773.084790:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521010048:12345-0@lo:400: 00000100:00100000:3.0:1783141773.084831:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521010048:12345-0@lo:400: Request processed in 42us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.084838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:01000000:3.0:1783141773.084859:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1783141773.084885:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783141773.084896:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.084907:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141773.084917:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141773.084926:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c4bd6c000 from 39 10000000:01000000:3.0:1783141773.084940:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141773.084971:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.084979:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.084989:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.085005:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010176:0@lo:101: 00000100:00100000:3.0:1783141773.085034:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.085064:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.085087:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521009024 00000100:00100000:3.0:1783141773.085092:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521009024 00000100:00100000:3.0:1783141773.085118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783141773.085124:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521009024:12345-0@lo:400: 00000100:00100000:3.0:1783141773.085155:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521009024:12345-0@lo:400: Request processed in 32us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.085161:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1783141773.085176:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141773.085180:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783141773.085467:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43516680 x1869759521008640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085581:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521009024:0@lo:400: 00010000:00080000:3.0:1783141773.085593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765500 x1869759521009536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085602:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521009536:0@lo:400: 00010000:00080000:3.0:1783141773.085613:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767100 x1869759521010048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085628:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521010048:0@lo:400: 00010000:00080000:3.0:1783141773.085654:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767800 x1869759521008896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085662:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521008896:0@lo:400: 00010000:00080000:3.0:1783141773.085673:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764000 x1869759521009408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085680:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521009408:0@lo:400: 00010000:00080000:3.0:1783141773.085691:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764a80 x1869759521009920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.085699:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521009920:0@lo:400: 00000100:00100000:3.0:1783141773.085731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010176 00000100:00100000:3.0:1783141773.085735:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010176 00000100:00100000:2.0:1783141773.085790:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141773.085799:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783141773.085808:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783141773.085813:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783141773.085816:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7dffc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783141773.085829:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783141773.085836:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521008640:0@lo:8: 00000100:00100000:3.0:1783141773.085908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783141773.085917:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521010176:12345-0@lo:101: 00010000:00010000:3.0:1783141773.085926:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141773.085948:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806d32 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.085970:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.085981:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.085990:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c82156400, rc 0) 00000100:00100000:3.0:1783141773.086039:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521010176:12345-0@lo:101: Request processed in 123us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.086045:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783141773.086683:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010176:0@lo:101: 00010000:00010000:3.0:1783141773.086701:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141773.086710:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141773.086769:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010304:0@lo:501: 00000100:00100000:3.0:1783141773.086803:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.086862:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.086973:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521010432:0@lo:700: 00000100:00100000:3.0:1783141773.087001:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.087024:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010432 00000100:00100000:3.0:1783141773.087029:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010432 00000100:00100000:3.0:1783141773.087073:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141773.087081:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9968:x1869759521010432:12345-0@lo:700: 00000100:00100000:3.0:1783141773.087108:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1869759521010560:0@lo:700: 00000100:00100000:3.0:1783141773.087132:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.087147:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43dcc0 going to sleep for 11 seconds 00000100:00080000:3.0:1783141773.087158:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141773.087164:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.087241:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010304 00000100:00100000:1.0:1783141773.087246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010304 00000100:00100000:3.0:1783141773.087314:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783141773.087322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521010304:12345-0@lo:501: 00000100:00100000:3.0:1783141773.087568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521010304:12345-0@lo:501: Request processed in 245us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.087585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783141773.087620:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010304:0@lo:501: 00000100:00100000:3.0:1783141773.087649:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010688:0@lo:503: 00000100:00100000:3.0:1783141773.087687:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.087712:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.087724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010688 00000100:00100000:3.0:1783141773.087727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010688 00000100:00100000:3.0:1783141773.087750:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783141773.087756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521010688:12345-0@lo:503: 00000100:00100000:3.0:1783141773.087825:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521010688:12345-0@lo:503: Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.087832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783141773.087870:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521010688:0@lo:503: 00000100:00100000:1.0:1783141773.088112:0:9969:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9969:1869759521010816:0@lo:502: 00000100:00100000:1.0:1783141773.088146:0:9969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.088166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010816 00000100:00100000:1.0:1783141773.088170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010816 00000100:00100000:3.0:1783141773.088302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783141773.088311:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:9969:x1869759521010816:12345-0@lo:502: 00000004:00080000:2.0:1783141773.088565:0:9967:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783141773.088631:0:9967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 284155358322ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783141773.088638:0:9967:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783141773.088663:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010560 00000100:00100000:2.0:1783141773.088667:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010560 00000100:00100000:2.0:1783141773.088697:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141773.088703:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1869759521010560:12345-0@lo:700: 00000100:00100000:3.0:1783141773.090018:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:9969:x1869759521010816:12345-0@lo:502: Request processed in 1702us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.090031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783141773.090234:0:9969:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.090260:0:9969:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9969:1869759521010816:0@lo:502: 00000100:00100000:1.0:1783141773.090350:0:9969:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9969:1869759521010944:0@lo:502: 00000100:00100000:1.0:1783141773.090542:0:9969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.090577:0:9969:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.090642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521010944 00000100:00100000:3.0:1783141773.090649:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521010944 00000100:00100000:3.0:1783141773.090687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783141773.090695:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:9969:x1869759521010944:12345-0@lo:502: 00000100:00100000:3.0:1783141773.090795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:9969:x1869759521010944:12345-0@lo:502: Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.090802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783141773.091010:0:9969:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9969:1869759521010944:0@lo:502: 00000040:00080000:1.0:1783141773.091032:0:9969:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783141773.091090:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783141773.091111:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783141773.091128:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.091138:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141773.091147:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783141773.091149:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c4bd6c000 from 6 10000000:01000000:1.0:1783141773.091153:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783141773.091177:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092576:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092596:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.092617:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011072:0@lo:101: 00000100:00100000:1.0:1783141773.092672:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.092705:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.092731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011072 00000100:00100000:1.0:1783141773.092737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011072 00000100:00100000:1.0:1783141773.092775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783141773.092783:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521011072:12345-0@lo:101: 00010000:00010000:1.0:1783141773.092795:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141773.092807:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806d40 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092829:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806d40 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092847:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d40 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092855:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e800, rc 0) 00000100:00100000:1.0:1783141773.092890:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521011072:12345-0@lo:101: Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.092897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783141773.092951:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011072:0@lo:101: 00010000:00010000:1.0:1783141773.092964:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.092973:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.093022:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011200:0@lo:256: 00000100:00100000:1.0:1783141773.093050:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.093064:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.093077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011200 00000100:00100000:1.0:1783141773.093081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011200 00000100:00100000:1.0:1783141773.093104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783141773.093110:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521011200:12345-0@lo:256: 20000000:01000000:1.0:1783141773.093122:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783141773.093137:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783141773.093140:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783141773.093223:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521011200:12345-0@lo:256: Request processed in 112us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.093229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783141773.093264:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011200:0@lo:256: 10000000:01000000:1.0:1783141773.093323:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141773.093329:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.093337:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141773.093344:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783141773.093346:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783141773.093348:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783141773.093364:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.093371:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141773.095850:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:1.0:1783141773.096318:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.096350:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011328:0@lo:101: 00000100:00100000:1.0:1783141773.096425:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.096469:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.097314:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011328 00000100:00100000:1.0:1783141773.097324:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011328 00000100:00100000:1.0:1783141773.097385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783141773.097395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521011328:12345-0@lo:101: 00010000:00010000:1.0:1783141773.097410:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141773.097439:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806d4e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.097471:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:2.0:1783141773.097666:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00010000:1.0:1783141773.098258:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.098291:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76345a00, rc 0) 00000100:00100000:1.0:1783141773.098355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521011328:12345-0@lo:101: Request processed in 961us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.098363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783141773.098418:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011328:0@lo:101: 00010000:00010000:1.0:1783141773.098434:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.098443:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.099620:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011456:0@lo:501: 00000100:00100000:1.0:1783141773.099673:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.099711:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.099732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011456 00000100:00100000:1.0:1783141773.099737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011456 00000100:00100000:1.0:1783141773.099772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783141773.099779:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521011456:12345-0@lo:501: 00000100:00100000:1.0:1783141773.099902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521011456:12345-0@lo:501: Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.099910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783141773.101400:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011456:0@lo:501: 00000100:00100000:1.0:1783141773.101445:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011584:0@lo:503: 00000100:00100000:1.0:1783141773.101572:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.101606:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762aa900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.101621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011584 00000100:00100000:1.0:1783141773.101625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011584 00000100:00100000:1.0:1783141773.101660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783141773.101668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521011584:12345-0@lo:503: 00000100:00100000:1.0:1783141773.101764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521011584:12345-0@lo:503: Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.101772:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783141773.101814:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521011584:0@lo:503: 00000100:00100000:2.0:1783141773.107385:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1869759521010560:12345-0@lo:700: Request processed in 18675us (20244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.107400:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141773.107915:0:9972:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9972:1869759521011712:0@lo:502: 00000100:00100000:1.0:1783141773.107985:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.108014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011712 00000100:00100000:1.0:1783141773.108020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011712 00000100:00100000:1.0:1783141773.108058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783141773.108066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:9972:x1869759521011712:12345-0@lo:502: 00000100:00100000:1.0:1783141773.108179:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:9972:x1869759521011712:12345-0@lo:502: Request processed in 114us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.108186:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783141773.108237:0:9972:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.108259:0:9972:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9972:1869759521011712:0@lo:502: 00000020:01000000:1.0:1783141773.108312:0:9972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783141773.108321:0:9972:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783141773.108329:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.108336:0:9972:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783141773.108345:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783141773.108350:0:9972:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:1.0:1783141773.108369:0:9972:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783141773.108372:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141773.108387:0:9972:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f9b432bb380) 00000020:00000080:1.0:1783141773.108409:0:9972:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1783141773.108414:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783141773.108497:0:9972:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783141773.108503:0:9972:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783141773.108520:0:9972:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3806d63 00010000:00080000:1.0:1783141773.108549:0:9972:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b435e4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783141773.108766:0:9972:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1783141773.108886:0:9972:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783141773.108897:0:9972:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783141773.109063:0:9972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141773.109848:0:9972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141773.110019:0:9972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783141773.110117:0:9972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00080000:3.0:1783141773.111561:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b41afdf80 x1869759521010560/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.111578:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1869759521010560:0@lo:700: 40000000:02000000:3.0:1783141773.111592:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1783141773.115655:0:9973:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141773.115663:0:9973:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783141773.117115:0:9972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141773.117129:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783141773.117176:0:9972:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783141773.118752:0:9972:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806d6a 00000100:00080000:1.0:1783141773.118766:0:9972:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783141773.118773:0:9972:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b435e4800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141773.118807:0:9972:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43555f80 x1869759521011840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141773.118864:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521011840:0@lo:8: 00000100:00100000:2.0:1783141773.118944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783141773.119507:0:9972:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783141773.119582:0:9972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141773.119589:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.119600:0:9972:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783141773.119605:0:9972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141773.119609:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.119610:0:9972:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783141773.119613:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783141773.119615:0:9972:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783141773.119642:0:9972:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9972:1869759521011968:0@lo:502: 00000100:00100000:1.0:1783141773.119691:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.119710:0:9972:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a4eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.119748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011968 00000100:00100000:1.0:1783141773.119754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011968 00000100:00100000:1.0:1783141773.119794:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783141773.119803:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:9972:x1869759521011968:12345-0@lo:502: 00000100:00100000:1.0:1783141773.119918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:9972:x1869759521011968:12345-0@lo:502: Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.119926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783141773.119995:0:9972:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:9972:1869759521011968:0@lo:502: 00000020:01000000:1.0:1783141773.120018:0:9972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141773.120022:0:9972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141773.120023:0:9972:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783141773.120027:0:9972:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1783141773.120132:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1783141773.120151:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783141773.120160:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120170:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141773.120179:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783141773.120197:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9c48c28000 from 1 10000000:01000000:1.0:1783141773.120199:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783141773.120220:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120228:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120237:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.120247:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521012096:0@lo:101: 00000100:00100000:1.0:1783141773.120290:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.120304:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.120316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012096 00000100:00100000:1.0:1783141773.120318:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012096 00000100:00100000:1.0:1783141773.120337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783141773.120343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521012096:12345-0@lo:101: 00010000:00010000:1.0:1783141773.120351:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141773.120361:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806d71 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120379:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120389:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120398:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344a00, rc 0) 00000100:00100000:1.0:1783141773.120421:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521012096:12345-0@lo:101: Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.120432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783141773.120457:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521012096:0@lo:101: 00010000:00010000:1.0:1783141773.120468:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120477:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.120514:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521012224:0@lo:501: 00000100:00100000:1.0:1783141773.120534:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.120545:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.120555:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012224 00000100:00100000:1.0:1783141773.120557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012224 00000100:00100000:1.0:1783141773.120574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783141773.120579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521012224:12345-0@lo:501: 00000100:00100000:1.0:1783141773.120632:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521012224:12345-0@lo:501: Request processed in 52us (96us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141773.120639:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783141773.120666:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521012224:0@lo:501: 10000000:01000000:1.0:1783141773.120683:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783141773.120688:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141773.120696:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141773.122471:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521011840 00000100:00100000:1.0:1783141773.124302:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521011840 00000100:00100000:1.0:1783141773.124356:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141773.124363:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1869759521011840:12345-0@lo:8: 00010000:00080000:1.0:1783141773.124409:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:1.0:1783141773.124439:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3806d7f 00002000:00100000:1.0:1783141773.124454:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f9b435e0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783141773.124459:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783141773.124461:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783141773.124539:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783141773.124565:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e1800 : changing import state from RECOVER to FULL 00000001:00100000:0.0:1783141773.133846:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783141773.133859:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783141773.134039:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521010432:12345-0@lo:700: Request processed in 46952us (47030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.134053:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783141773.134084:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b41afd180 x1869759521010432/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141773.134100:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521010432:0@lo:700: 00000100:00100000:1.0:1783141773.136259:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759521011840:12345-0@lo:8: Request processed in 11887us (17308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.136283:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783141773.139769:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43555f80 x1869759521011840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141773.139785:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141773.139808:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783141773.139817:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783141773.139823:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783141773.139826:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783141773.139846:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783141773.139853:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521011840:0@lo:8: 00000004:00080000:2.0:1783141773.139891:0:9973:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783141773.139973:0:9973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284206700671ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783141773.139979:0:9973:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783141773.143181:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783141773.143330:0:9968:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783141773.143367:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012480:0@lo:7: 00000100:00100000:3.0:1783141773.143621:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.143672:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.143699:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521012352:0@lo:13: 00000100:00100000:3.0:1783141773.143726:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.143769:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012480 00000100:00100000:3.0:1783141773.143775:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012480 00000100:00100000:3.0:1783141773.143822:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141773.143831:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521012480:12345-0@lo:7: 00000100:00100000:1.0:1783141773.145610:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012352 00000100:00100000:1.0:1783141773.145624:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012352 00000100:00100000:1.0:1783141773.146072:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141773.146084:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521012352:12345-0@lo:13: 00002000:00000024:1.0:1783141773.146116:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:1.0:1783141773.146202:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521012352:12345-0@lo:13: Request processed in 119us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.146209:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:3.0:1783141773.147698:0:8865:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783141773.147707:0:8865:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783141773.147780:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521012480:12345-0@lo:7: Request processed in 3946us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.147791:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783141773.147846:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7628f800 x1869759521012352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.147869:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521012352:0@lo:13: 00010000:00080000:3.0:1783141773.147912:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b41afd180 x1869759521012480/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.147942:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012480:0@lo:7: 00000004:00080000:3.0:1783141773.147954:0:9968:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783141773.147984:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012608:0@lo:5: 00000100:00100000:3.0:1783141773.148017:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.148040:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.148058:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012608 00000100:00100000:3.0:1783141773.148065:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012608 00000100:00100000:3.0:1783141773.148148:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141773.148158:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521012608:12345-0@lo:5: 00002000:00080000:3.0:1783141773.148182:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1783141773.148214:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521012608:12345-0@lo:5: Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.148219:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783141773.148344:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c44279500 x1869759521012608/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.148354:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012608:0@lo:5: 00000004:00080000:3.0:1783141773.148361:0:9968:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783141773.148382:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012736:0@lo:5: 00000100:00100000:3.0:1783141773.148403:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.148455:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.148489:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012736 00000100:00100000:1.0:1783141773.148493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012736 00000100:00100000:1.0:1783141773.148557:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141773.148566:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9968:x1869759521012736:12345-0@lo:5: 00002000:00080000:1.0:1783141773.148586:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1783141773.150108:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9968:x1869759521012736:12345-0@lo:5: Request processed in 1540us (1699us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783141773.150125:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783141773.150237:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c44279500 x1869759521012736/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.150252:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1869759521012736:0@lo:5: 00000004:00080000:3.0:1783141773.150265:0:9968:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783141773.150332:0:9968:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9968:1869759521012864:0@lo:900: 00000100:00100000:3.0:1783141773.150368:0:9968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.150391:0:9968:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.150450:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012864 00000100:00100000:1.0:1783141773.150456:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012864 00000100:00100000:1.0:1783141773.150496:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141773.150503:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9968:x1869759521012864:12345-0@lo:900: 00000100:00100000:1.0:1783141773.150571:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9968:x1869759521012864:12345-0@lo:900: Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.150580:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:1.0:1783141773.150619:0:9975:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783141773.150629:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013120:0@lo:7: 00000100:00100000:1.0:1783141773.150651:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141773.150670:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.150679:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013120 00000100:00100000:1.0:1783141773.150681:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013120 00000100:00100000:1.0:1783141773.150713:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141773.150720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9975:x1869759521013120:12345-0@lo:7: 00000100:00100000:2.0:1783141773.151351:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521012992:0@lo:13: 00010000:00080000:3.0:1783141773.151383:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7628f800 x1869759521012864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141773.151387:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.151396:0:9968:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9968:1869759521012864:0@lo:900: 00000100:00080000:3.0:1783141773.151427:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141773.151441:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521012992 00000100:00100000:2.0:1783141773.151444:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521012992 00000100:00100000:2.0:1783141773.151476:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141773.151484:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521012992:12345-0@lo:13: 00002000:00000024:2.0:1783141773.151498:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1783141773.151539:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521012992:12345-0@lo:13: Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141773.151546:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783141773.151565:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557800 x1869759521012992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.151579:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521012992:0@lo:13: 00002000:00080000:1.0:1783141773.154621:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1783141773.154629:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783141773.154759:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9975:x1869759521013120:12345-0@lo:7: Request processed in 4036us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.154771:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783141773.154838:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43554e00 x1869759521013120/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141773.154854:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013120:0@lo:7: 00000004:00080000:2.0:1783141773.154868:0:9975:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783141773.154906:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013248:0@lo:5: 00000100:00100000:2.0:1783141773.154952:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141773.154990:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b421c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141773.155020:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013248 00000100:00100000:3.0:1783141773.155027:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013248 00000100:00100000:3.0:1783141773.155176:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141773.155185:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9975:x1869759521013248:12345-0@lo:5: 00002000:00080000:3.0:1783141773.155207:0:8865:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783141773.155211:0:8865:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783141773.155475:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9975:x1869759521013248:12345-0@lo:5: Request processed in 291us (522us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783141773.155483:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783141773.155529:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43517100 x1869759521013248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141773.155539:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013248:0@lo:5: 00000004:00080000:2.0:1783141773.155546:0:9975:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783141773.155566:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013376:0@lo:700: 00000100:00100000:2.0:1783141773.155587:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141773.155610:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b421c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.155653:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013376 00000100:00100000:1.0:1783141773.155656:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013376 00000100:00100000:1.0:1783141773.155685:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141773.155691:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9975:x1869759521013376:12345-0@lo:700: 00000001:00080000:3.0:1783141773.194918:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1783141773.194946:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1783141773.195214:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9975:x1869759521013376:12345-0@lo:700: Request processed in 39517us (39620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141773.195234:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783141773.195335:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43516a00 x1869759521013376/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141773.195347:0:9975:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783141773.195363:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013376:0@lo:700: 00010000:00010000:2.0:1783141773.196020:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1783141773.207629:0:9975:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1783141773.211104:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013504:0@lo:5: 00000100:00100000:0.0:1783141773.211179:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141773.211313:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38600 going to sleep for 11 seconds 00000100:00100000:1.0:1783141773.212650:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013504 00000100:00100000:1.0:1783141773.212661:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013504 00000100:00100000:1.0:1783141773.212726:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141773.212772:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9975:x1869759521013504:12345-0@lo:5: 00002000:00080000:2.0:1783141773.218246:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1783141773.218267:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1783141773.220000:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9975:x1869759521013504:12345-0@lo:5: Request processed in 7261us (8817us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783141773.220013:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783141773.220039:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dd500 x1869759521013504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141773.220058:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9975:1869759521013504:0@lo:5: 00000004:00080000:0.0:1783141773.220083:0:9975:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1783141773.247131:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1783141773.573022:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521013632:0@lo:41: 00000100:00100000:0.0:1783141773.573097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141773.573403:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013632 00000100:00100000:3.0:1783141773.573410:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013632 00000100:00100000:3.0:1783141773.573481:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783141773.573491:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521013632:12345-0@lo:41: 00000004:00000024:3.0:1783141773.573523:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783141773.573598:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521013632:12345-0@lo:41: Request processed in 108us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141773.573606:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783141773.573769:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521013632:0@lo:41: 00000100:00100000:0.0:1783141774.084804:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141774.084829:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521013760:0@lo:13: 00000100:00100000:0.0:1783141774.084897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141774.085508:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013760 00000100:00100000:2.0:1783141774.085516:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013760 00000100:00100000:2.0:1783141774.085565:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141774.085575:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521013760:12345-0@lo:13: 00002000:00000024:2.0:1783141774.085606:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141774.085673:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521013760:12345-0@lo:13: Request processed in 99us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141774.085680:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1783141774.085820:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43556300 x1869759521013760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141774.085839:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521013760:0@lo:13: 00010000:00010000:2.0:1783141774.214550:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141774.597658:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521013888:0@lo:13: 00000100:00100000:3.0:1783141774.597729:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141774.598518:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521013888 00000100:00100000:1.0:1783141774.598527:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521013888 00000100:00100000:1.0:1783141774.598583:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141774.598592:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521013888:12345-0@lo:13: 00002000:00000024:1.0:1783141774.598616:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141774.599855:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521013888:12345-0@lo:13: Request processed in 1259us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141774.599866:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783141774.600841:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6cccbb80 x1869759521013888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141774.600864:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521013888:0@lo:13: 00010000:00010000:0.0:1783141775.247836:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783141775.323856:0:10041:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141775.324166:0:10041:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141776.261248:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783141776.499692:0:10090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141776.499702:0:10090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1783141777.151028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.151485:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501041792 00000100:00100000:2.0:1783141777.151495:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501041792 00000100:00100000:2.0:1783141777.151557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:2.0:1783141777.151565:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1869759501041792:12345-192.168.203.39@tcp:250: 00010000:00080000:2.0:1783141777.151591:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f@192.168.203.39@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1783141777.151617:0:6517:0:(genops.c:1406:class_connect()) connect: client 81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f, cookie 0xb31399d6a3806d86 00000100:00080000:2.0:1783141777.151751:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141777.151831:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+5:2399:x1869759501041792:12345-192.168.203.39@tcp:250: Request processed in 265us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.151840:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:3.0:1783141777.174052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.174377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501041920 00000100:00100000:1.0:1783141777.174388:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501041920 00000100:00100000:1.0:1783141777.174586:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:1.0:1783141777.174599:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+5:6157:x1869759501041920:12345-192.168.203.39@tcp:101: 00010000:00010000:1.0:1783141777.174616:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141777.174632:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e4ad expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.174673:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.174684:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.174712:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344200, rc 0) 00000100:00100000:1.0:1783141777.174776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+6:6157:x1869759501041920:12345-192.168.203.39@tcp:101: Request processed in 180us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.174783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:0.0:1783141777.179178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.179929:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042048 00000100:00100000:1.0:1783141777.179939:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042048 00000100:00100000:1.0:1783141777.180001:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:1.0:1783141777.180010:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+6:6157:x1869759501042048:12345-192.168.203.39@tcp:501: 00000100:00100000:1.0:1783141777.180130:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+6:6157:x1869759501042048:12345-192.168.203.39@tcp:501: Request processed in 121us (960us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141777.180139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783141777.184845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.185606:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042176 00000100:00100000:2.0:1783141777.185619:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042176 00000100:00100000:2.0:1783141777.185692:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:2.0:1783141777.185703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+6:6157:x1869759501042176:12345-192.168.203.39@tcp:101: 00010000:00010000:2.0:1783141777.185721:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141777.185741:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e4b4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.185773:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.185785:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.185795:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3600, rc 0) 00000100:00100000:2.0:1783141777.185868:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+7:6157:x1869759501042176:12345-192.168.203.39@tcp:101: Request processed in 166us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.185875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:3.0:1783141777.187624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.187929:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042304 00000100:00100000:2.0:1783141777.187950:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042304 00000100:00100000:2.0:1783141777.188000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:2.0:1783141777.188008:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+7:6157:x1869759501042304:12345-192.168.203.39@tcp:501: 00000100:00100000:2.0:1783141777.188153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6157:x1869759501042304:12345-192.168.203.39@tcp:501: Request processed in 145us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.188160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:0.0:1783141777.198999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.199163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042432 00000100:00100000:1.0:1783141777.199173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042432 00000100:00100000:1.0:1783141777.199238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 184 00000100:00100000:1.0:1783141777.199248:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6157:x1869759501042432:12345-192.168.203.39@tcp:503: 00000100:00100000:1.0:1783141777.199605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6157:x1869759501042432:12345-192.168.203.39@tcp:503: Request processed in 357us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.199613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 184 00000100:00100000:3.0:1783141777.202383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.203627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042560 00000100:00100000:1.0:1783141777.203638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042560 00000100:00100000:1.0:1783141777.203770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 185 00000100:00100000:1.0:1783141777.203779:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6176:x1869759501042560:12345-192.168.203.39@tcp:502: 00000100:00100000:1.0:1783141777.204050:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6176:x1869759501042560:12345-192.168.203.39@tcp:502: Request processed in 271us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.204068:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 185 00010000:00010000:0.0:1783141777.286023:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141777.296840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.297160:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042688 00000100:00100000:2.0:1783141777.297170:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042688 00000100:00100000:2.0:1783141777.297239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 186 00000100:00100000:2.0:1783141777.297249:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6176:x1869759501042688:12345-192.168.203.39@tcp:502: 00000100:00100000:2.0:1783141777.297452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6176:x1869759501042688:12345-192.168.203.39@tcp:502: Request processed in 204us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.297461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 186 00000100:00100000:0.0:1783141777.308164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.312851:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042816 00000100:00100000:2.0:1783141777.312864:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042816 00000100:00100000:2.0:1783141777.312947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:2.0:1783141777.312957:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6157:x1869759501042816:12345-192.168.203.39@tcp:101: 00010000:00010000:2.0:1783141777.312974:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141777.312992:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e4e5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.313020:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4e5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.313031:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4e5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141777.313039:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2e00, rc 0) 00000100:00100000:2.0:1783141777.313124:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6157:x1869759501042816:12345-192.168.203.39@tcp:101: Request processed in 167us (4968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.313132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:3.0:1783141777.320819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.321227:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501042944 00000100:00100000:2.0:1783141777.321238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501042944 00000100:00100000:2.0:1783141777.324459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:2.0:1783141777.324481:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6157:x1869759501042944:12345-192.168.203.39@tcp:256: 20000000:01000000:2.0:1783141777.324512:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783141777.324535:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783141777.324540:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783141777.324543:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783141777.324545:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783141777.324548:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1783141777.332236:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6157:x1869759501042944:12345-192.168.203.39@tcp:256: Request processed in 7754us (11414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.332250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:0.0:1783141777.335345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.335424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043072 00000100:00100000:1.0:1783141777.335433:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043072 00000100:00100000:1.0:1783141777.335663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:1.0:1783141777.335675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6157:x1869759501043072:12345-192.168.203.39@tcp:101: 00010000:00010000:1.0:1783141777.335691:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141777.335706:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e4ec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.335734:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.335745:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141777.335754:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76345800, rc 0) 00000100:00100000:1.0:1783141777.336127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6157:x1869759501043072:12345-192.168.203.39@tcp:101: Request processed in 452us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.336135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:3.0:1783141777.349980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.350080:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043200 00000100:00100000:2.0:1783141777.350090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043200 00000100:00100000:2.0:1783141777.350146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:2.0:1783141777.350154:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6157:x1869759501043200:12345-192.168.203.39@tcp:501: 00000100:00100000:2.0:1783141777.350331:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6157:x1869759501043200:12345-192.168.203.39@tcp:501: Request processed in 176us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.350339:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:3.0:1783141777.362018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.363340:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043328 00000100:00100000:2.0:1783141777.363682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043328 00000100:00100000:2.0:1783141777.363920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:2.0:1783141777.363932:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6157:x1869759501043328:12345-192.168.203.39@tcp:503: 00000100:00100000:2.0:1783141777.364117:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6157:x1869759501043328:12345-192.168.203.39@tcp:503: Request processed in 187us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.364125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:0.0:1783141777.368471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.368738:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043456 00000100:00100000:1.0:1783141777.368747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043456 00000100:00100000:1.0:1783141777.368804:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:1.0:1783141777.368814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6184:x1869759501043456:12345-192.168.203.39@tcp:502: 00000100:00100000:1.0:1783141777.369086:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6184:x1869759501043456:12345-192.168.203.39@tcp:502: Request processed in 158us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.369096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:3.0:1783141777.376304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141777.376706:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043584 00000100:00100000:2.0:1783141777.376716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043584 00000100:00100000:2.0:1783141777.376786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:2.0:1783141777.376795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6184:x1869759501043584:12345-192.168.203.39@tcp:502: 00000100:00100000:2.0:1783141777.376952:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6184:x1869759501043584:12345-192.168.203.39@tcp:502: Request processed in 157us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141777.376960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:3.0:1783141777.394011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141777.394064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141777.394509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043712 00000100:00100000:1.0:1783141777.394527:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043712 00000100:00100000:1.0:1783141777.394569:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043968 00000100:00100000:1.0:1783141777.394572:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043968 00000100:00100000:1.0:1783141777.394600:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783141777.394607:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1869759501043712:12345-192.168.203.39@tcp:38: 00010000:00080000:1.0:1783141777.394635:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1783141777.394680:0:6524:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3806da9 00000004:00100000:1.0:1783141777.394705:0:6524:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783141777.395220:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141777.396128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501043712:12345-192.168.203.39@tcp:38: Request processed in 1516us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.396139:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783141777.396167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783141777.396173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1869759501043968:12345-192.168.203.39@tcp:38: 00010000:00080000:1.0:1783141777.396193:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1783141777.396235:0:6524:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3806db0 00000004:00100000:1.0:1783141777.398281:0:6524:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783141777.398755:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141777.399134:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501043968:12345-192.168.203.39@tcp:38: Request processed in 2957us (5067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.399144:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783141777.668919:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141777.668945:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521014016:0@lo:41: 00000100:00100000:3.0:1783141777.669012:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141777.669968:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014016 00000100:00100000:1.0:1783141777.669978:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014016 00000100:00100000:1.0:1783141777.670080:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141777.670090:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521014016:12345-0@lo:41: 00000004:00000024:1.0:1783141777.670126:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141777.670201:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521014016:12345-0@lo:41: Request processed in 112us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141777.670209:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783141777.670325:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521014016:0@lo:41: 00000100:00100000:2.0:1783141778.182052:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141778.182079:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521014144:0@lo:13: 00000100:00100000:2.0:1783141778.182254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141778.182373:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014144 00000100:00100000:3.0:1783141778.182381:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014144 00000100:00100000:3.0:1783141778.182436:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141778.182445:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521014144:12345-0@lo:13: 00002000:00000024:3.0:1783141778.182472:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141778.182514:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521014144:12345-0@lo:13: Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.182520:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783141778.182553:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a0a80 x1869759521014144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141778.182563:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783141778.182579:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521014144:0@lo:13: 00000100:00080000:2.0:1783141778.185355:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141778.186215:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141778.186237:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521014272:0@lo:13: 00000100:00100000:1.0:1783141778.186328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141778.186386:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014272 00000100:00100000:1.0:1783141778.186393:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014272 00000100:00100000:1.0:1783141778.186454:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783141778.186463:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521014272:12345-0@lo:13: 00002000:00000024:1.0:1783141778.186485:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141778.186529:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521014272:12345-0@lo:13: Request processed in 66us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141778.186536:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783141778.186555:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783141778.186579:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6cccbb80 x1869759521014272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141778.186590:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1783141778.186611:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521014272:0@lo:13: 00000100:00100000:2.0:1783141778.187004:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521014656:0@lo:400: 00000100:00100000:2.0:1783141778.187038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141778.187078:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141778.187084:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521014784:0@lo:400: 00000100:00100000:2.0:1783141778.187110:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141778.187156:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521015168:0@lo:400: 00000100:00100000:2.0:1783141778.187177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141778.187230:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141778.187237:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521015296:0@lo:400: 00000100:00100000:2.0:1783141778.187295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141778.187350:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521015680:0@lo:400: 00000100:00100000:2.0:1783141778.187372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141778.187398:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014784 00000100:00100000:2.0:1783141778.187402:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014784 00000100:00100000:2.0:1783141778.187439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015168 00000100:00100000:2.0:1783141778.187442:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015168 00000100:00100000:2.0:1783141778.187459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015680 00000100:00100000:2.0:1783141778.187462:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015680 00000100:00100000:2.0:1783141778.187477:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141778.187484:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521014784:12345-0@lo:400: 00000100:00100000:2.0:1783141778.187522:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521014784:12345-0@lo:400: Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.187529:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141778.187543:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141778.187550:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521015168:12345-0@lo:400: 00000100:00100000:2.0:1783141778.187588:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521015168:12345-0@lo:400: Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.187595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141778.187607:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141778.187613:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521015680:12345-0@lo:400: 00000100:00100000:2.0:1783141778.187638:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521015680:12345-0@lo:400: Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.187644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783141778.187669:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762aea00 x1869759521015680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141778.187680:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521015680:0@lo:400: 00010000:00080000:2.0:1783141778.187691:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514700 x1869759521015168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141778.187706:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521015168:0@lo:400: 00010000:00080000:2.0:1783141778.187730:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43515180 x1869759521014784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141778.187739:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521014784:0@lo:400: 00000100:00100000:0.0:1783141778.188094:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014656 00000100:00100000:0.0:1783141778.188099:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014656 00000100:00100000:0.0:1783141778.188137:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141778.188144:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521014656:12345-0@lo:400: 00000100:00100000:0.0:1783141778.188187:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521014656:12345-0@lo:400: Request processed in 44us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.188193:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141778.188217:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521014400:0@lo:400: 00000100:00100000:0.0:1783141778.188246:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188311:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521014912:0@lo:400: 00000100:00100000:0.0:1783141778.188335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188351:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521015424:0@lo:400: 00000100:00100000:0.0:1783141778.188382:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188402:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783141778.188408:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521014528:0@lo:400: 00000100:00100000:0.0:1783141778.188442:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188459:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521015040:0@lo:400: 00000100:00100000:0.0:1783141778.188478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188491:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521015552:0@lo:400: 00000100:00100000:0.0:1783141778.188507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141778.188522:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014528 00000100:00100000:0.0:1783141778.188525:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014528 00000100:00100000:0.0:1783141778.188548:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015040 00000100:00100000:0.0:1783141778.188550:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015040 00000100:00100000:0.0:1783141778.188563:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015552 00000100:00100000:0.0:1783141778.188565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015552 00000100:00100000:0.0:1783141778.188580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141778.188585:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521014528:12345-0@lo:400: 00000100:00100000:0.0:1783141778.188620:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521014528:12345-0@lo:400: Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.188626:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141778.188637:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141778.188642:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521015040:12345-0@lo:400: 00000100:00100000:0.0:1783141778.188668:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521015040:12345-0@lo:400: Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.188674:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141778.188685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783141778.188691:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521015552:12345-0@lo:400: 00000100:00100000:0.0:1783141778.188726:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521015552:12345-0@lo:400: Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.188732:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783141778.188749:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014912 00000100:00100000:0.0:1783141778.188753:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014912 00000100:00100000:0.0:1783141778.188773:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783141778.188779:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521014912:12345-0@lo:400: 00000100:00100000:0.0:1783141778.188805:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521014912:12345-0@lo:400: Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.188811:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783141778.189112:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43515f80 x1869759521014528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141778.189131:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521014528:0@lo:400: 00010000:00080000:0.0:1783141778.189144:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514000 x1869759521015040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141778.189153:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521015040:0@lo:400: 00010000:00080000:0.0:1783141778.189162:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ac380 x1869759521015552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141778.189170:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521015552:0@lo:400: 00000100:00100000:0.0:1783141778.189180:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521014912:0@lo:400: 00000100:00100000:0.0:1783141778.189214:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521014656:0@lo:400: 00000100:00100000:3.0:1783141778.189658:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015296 00000100:00100000:3.0:1783141778.189664:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015296 00000100:00100000:3.0:1783141778.189703:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015424 00000100:00100000:3.0:1783141778.189706:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015424 00000100:00100000:3.0:1783141778.189738:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141778.189745:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521015296:12345-0@lo:400: 00000100:00100000:3.0:1783141778.189790:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521015296:12345-0@lo:400: Request processed in 46us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.189797:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141778.189809:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141778.189815:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521015424:12345-0@lo:400: 00000100:00100000:3.0:1783141778.189856:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521015424:12345-0@lo:400: Request processed in 42us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.189863:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783141778.189907:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762af100 x1869759521015424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141778.189933:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521015424:0@lo:400: 00000100:00080000:1.0:1783141778.190001:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141778.190006:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141778.190008:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783141778.190082:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ac000 x1869759521015296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141778.190091:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521015296:0@lo:400: 00000100:00100000:2.0:1783141778.190162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521014400 00000100:00100000:2.0:1783141778.190166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521014400 00000100:00100000:2.0:1783141778.190203:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783141778.190210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521014400:12345-0@lo:400: 00000100:00100000:2.0:1783141778.190253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521014400:12345-0@lo:400: Request processed in 44us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.190269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783141778.190547:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521014400:0@lo:400: 00010000:00010000:2.0:1783141778.308480:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141778.410186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.410264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.410583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141778.410654:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044224 00000100:00100000:0.0:1783141778.410663:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044224 00000100:00100000:0.0:1783141778.410759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044096 00000100:00100000:0.0:1783141778.410762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044096 00000100:00100000:3.0:1783141778.410805:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501043840 00000100:00100000:3.0:1783141778.410808:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501043840 00000100:00100000:3.0:1783141778.410827:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:3.0:1783141778.410835:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:6157:x1869759501044224:12345-192.168.203.39@tcp:41: 00000004:00000024:3.0:1783141778.410869:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:1.0:1783141778.411012:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141778.411016:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141778.411030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1783141778.411038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:0:x1869759501043840:12345-192.168.203.39@tcp:41: 00000004:00000024:1.0:1783141778.411050:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783141778.411109:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:0:x1869759501043840:12345-192.168.203.39@tcp:41: Request processed in 72us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141778.411116:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783141778.411433:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044224:12345-192.168.203.39@tcp:41: Request processed in 597us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.411448:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1783141778.412299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783141778.412308:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:0:x1869759501044096:12345-192.168.203.39@tcp:41: 00000004:00000024:0.0:1783141778.412334:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783141778.412380:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:0:x1869759501044096:12345-192.168.203.39@tcp:41: Request processed in 73us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141778.412387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783141778.421717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.423015:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044352 00000100:00100000:3.0:1783141778.423027:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044352 00000100:00100000:3.0:1783141778.423149:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:3.0:1783141778.423160:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044352:12345-192.168.203.39@tcp:40: 00000100:00100000:3.0:1783141778.423245:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044352:12345-192.168.203.39@tcp:40: Request processed in 87us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.423251:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:3.0:1783141778.428127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.428178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141778.428305:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044480 00000100:00100000:1.0:1783141778.428306:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044608 00000100:00100000:1.0:1783141778.428316:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044608 00000100:00100000:0.0:1783141778.428324:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044480 00000100:00100000:1.0:1783141778.428410:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783141778.428418:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1869759501044608:12345-192.168.203.39@tcp:8: 00010000:00080000:1.0:1783141778.428449:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1783141778.428488:0:8438:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3806db7 00002000:00100000:1.0:1783141778.428498:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 51a41658-4bb5-47ac-acec-f543eb9c9e19/ffff9f9b432c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141778.428509:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141778.428661:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783141778.428687:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141778.428759:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501044608:12345-192.168.203.39@tcp:8: Request processed in 340us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141778.428767:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783141778.428783:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783141778.428788:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1869759501044480:12345-192.168.203.39@tcp:8: 00010000:00080000:1.0:1783141778.428801:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1783141778.428818:0:8438:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3806dbe 00002000:00100000:1.0:1783141778.428823:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 51a41658-4bb5-47ac-acec-f543eb9c9e19/ffff9f9b432c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141778.428833:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141778.428933:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783141778.428952:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141778.428973:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501044480:12345-192.168.203.39@tcp:8: Request processed in 184us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141778.428980:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:3.0:1783141778.434756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.434837:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044736 00000100:00100000:3.0:1783141778.434848:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044736 00000100:00100000:3.0:1783141778.434944:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783141778.434953:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044736:12345-192.168.203.39@tcp:900: 00000100:00100000:3.0:1783141778.435025:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044736:12345-192.168.203.39@tcp:900: Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.435033:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783141778.438771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141778.438993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044864 00000100:00100000:1.0:1783141778.439002:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044864 00000100:00100000:1.0:1783141778.439053:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783141778.439062:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044864:12345-192.168.203.39@tcp:33: 00000100:00100000:0.0:1783141778.443240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141778.443356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501044992 00000100:00100000:3.0:1783141778.443367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501044992 00000100:00100000:3.0:1783141778.443546:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 195 00000100:00100000:3.0:1783141778.443557:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501044992:12345-192.168.203.39@tcp:400: 00000100:00100000:3.0:1783141778.443634:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501044992:12345-192.168.203.39@tcp:400: Request processed in 79us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141778.443642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 195 00000004:00080000:2.0:1783141778.461167:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22021us 00000004:00200000:2.0:1783141778.483636:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783141778.483741:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6157:x1869759501044864:12345-192.168.203.39@tcp:33: Request processed in 44674us (44972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.483754:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1783141778.692793:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521015808:0@lo:41: 00000100:00100000:2.0:1783141778.692866:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141778.693023:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015808 00000100:00100000:1.0:1783141778.693031:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015808 00000100:00100000:1.0:1783141778.693096:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141778.693106:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521015808:12345-0@lo:41: 00000004:00000024:1.0:1783141778.693133:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783141778.693184:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521015808:12345-0@lo:41: Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141778.693191:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783141778.693312:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521015808:0@lo:41: 00000100:00100000:0.0:1783141778.772047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141778.772169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045120 00000100:00100000:2.0:1783141778.772181:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045120 00000100:00100000:2.0:1783141778.772249:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783141778.772259:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6202:x1869759501045120:12345-192.168.203.39@tcp:101: 00010000:00010000:2.0:1783141778.772305:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141778.772415:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e51d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772480:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772493:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772507:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141778.772553:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783141778.772558:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141778.772574:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772600:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e51d expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772618:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e51d expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141778.772627:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4218ba00) 00010000:00010000:2.0:1783141778.772630:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141778.772634:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3400, rc 0) 00000100:00100000:2.0:1783141778.772696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:6202:x1869759501045120:12345-192.168.203.39@tcp:101: Request processed in 438us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141778.772704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1783141779.204584:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141779.204612:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521015936:0@lo:13: 00000100:00100000:0.0:1783141779.204680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141779.204793:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521015936 00000100:00100000:1.0:1783141779.204811:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521015936 00000100:00100000:1.0:1783141779.204862:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141779.204872:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521015936:12345-0@lo:13: 00002000:00000024:1.0:1783141779.204904:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141779.204950:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521015936:12345-0@lo:13: Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141779.204958:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783141779.206286:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43554700 x1869759521015936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141779.206326:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521015936:0@lo:13: 00010000:00010000:0.0:1783141779.332497:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141779.718998:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521016064:0@lo:13: 00000100:00100000:2.0:1783141779.719068:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141779.721371:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016064 00000100:00100000:1.0:1783141779.721386:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016064 00000100:00100000:1.0:1783141779.721446:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141779.721456:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521016064:12345-0@lo:13: 00002000:00000024:1.0:1783141779.721496:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141779.734869:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521016064:12345-0@lo:13: Request processed in 13403us (15790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141779.734893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783141779.747234:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76318e00 x1869759521016064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141779.747261:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521016064:0@lo:13: 00010000:00010000:2.0:1783141780.356560:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141781.318049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141781.318177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045248 00000100:00100000:0.0:1783141781.318186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045248 00000100:00100000:0.0:1783141781.318255:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:0.0:1783141781.318266:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:6255:x1869759501045248:12345-192.168.203.39@tcp:41: 00000004:00000024:0.0:1783141781.318330:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783141781.318396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:6255:x1869759501045248:12345-192.168.203.39@tcp:41: Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141781.318402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00080000:1.0:1783141781.318798:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141781.322717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141781.322811:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045376 00000100:00100000:2.0:1783141781.322820:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045376 00000100:00100000:2.0:1783141781.322896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783141781.322907:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045376:12345-192.168.203.39@tcp:41: 00000004:00000024:2.0:1783141781.322945:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141781.323020:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045376:12345-192.168.203.39@tcp:41: Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141781.323028:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00080000:1.0:1783141781.323669:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141781.333495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141781.333589:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045504 00000100:00100000:0.0:1783141781.333599:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045504 00000100:00100000:0.0:1783141781.333722:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:0.0:1783141781.333734:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045504:12345-192.168.203.39@tcp:13: 00002000:00000024:0.0:1783141781.333766:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141781.333835:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045504:12345-192.168.203.39@tcp:13: Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141781.333842:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00080000:1.0:1783141781.334776:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141781.345063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141781.345396:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045632 00000100:00100000:0.0:1783141781.345406:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045632 00000100:00100000:0.0:1783141781.345482:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1783141781.345494:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045632:12345-192.168.203.39@tcp:13: 00002000:00000024:0.0:1783141781.345544:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141781.345617:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:6255:x1869759501045632:12345-192.168.203.39@tcp:13: Request processed in 126us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141781.345625:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00080000:1.0:1783141781.346915:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783141781.383930:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141781.770133:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00010000:00010000:1.0:1783141782.404686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141782.788746:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521016192:0@lo:41: 00000100:00100000:1.0:1783141782.788812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141782.788899:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016192 00000100:00100000:1.0:1783141782.788907:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016192 00000100:00100000:1.0:1783141782.788949:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141782.788958:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521016192:12345-0@lo:41: 00000004:00000024:1.0:1783141782.788988:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141782.789030:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521016192:12345-0@lo:41: Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141782.789037:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141782.789093:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521016192:0@lo:41: 00000001:00100000:2.0:1783141782.791449:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000001:00100000:3.0:1783141782.792017:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000100:00100000:1.0:1783141783.300664:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521016320:0@lo:13: 00000100:00100000:1.0:1783141783.300738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141783.300873:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016320 00000100:00100000:3.0:1783141783.300881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016320 00000100:00100000:3.0:1783141783.300955:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141783.300965:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521016320:12345-0@lo:13: 00002000:00000024:3.0:1783141783.300994:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141783.301038:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521016320:12345-0@lo:13: Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141783.301045:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783141783.301371:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783141783.301400:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a2d80 x1869759521016320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141783.301418:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521016320:0@lo:13: 00000100:00100000:3.0:1783141783.301568:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521016448:0@lo:13: 00000100:00100000:3.0:1783141783.301605:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141783.301694:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016448 00000100:00100000:0.0:1783141783.301699:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016448 00000100:00100000:0.0:1783141783.301738:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141783.301745:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521016448:12345-0@lo:13: 00002000:00000024:0.0:1783141783.301758:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141783.301801:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521016448:12345-0@lo:13: Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141783.301808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783141783.301882:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76319180 x1869759521016448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141783.301896:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521016448:0@lo:13: 00000100:00080000:1.0:1783141783.302026:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141783.302513:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521016704:0@lo:400: 00000100:00100000:1.0:1783141783.302549:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302570:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521017216:0@lo:400: 00000100:00100000:1.0:1783141783.302590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302608:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521017728:0@lo:400: 00000100:00100000:1.0:1783141783.302627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302643:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783141783.302648:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521016832:0@lo:400: 00000100:00100000:1.0:1783141783.302670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302685:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521017344:0@lo:400: 00000100:00100000:1.0:1783141783.302703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302715:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521017856:0@lo:400: 00000100:00100000:1.0:1783141783.302738:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.302764:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016704 00000100:00100000:1.0:1783141783.302768:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016704 00000100:00100000:1.0:1783141783.302790:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017216 00000100:00100000:1.0:1783141783.302793:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017216 00000100:00100000:1.0:1783141783.302812:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017728 00000100:00100000:1.0:1783141783.302814:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017728 00000100:00100000:1.0:1783141783.302828:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017344 00000100:00100000:1.0:1783141783.302831:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017344 00000100:00100000:1.0:1783141783.302842:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017856 00000100:00100000:1.0:1783141783.302845:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017856 00000100:00100000:1.0:1783141783.302893:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141783.302901:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521016704:12345-0@lo:400: 00000100:00100000:1.0:1783141783.302959:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521016704:12345-0@lo:400: Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.302972:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141783.302990:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783141783.302996:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521017216:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303024:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521017216:12345-0@lo:400: Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303029:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783141783.303042:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141783.303048:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521017728:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303072:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521017728:12345-0@lo:400: Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303077:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141783.303091:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141783.303097:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521017344:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303134:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521017344:12345-0@lo:400: Request processed in 37us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303139:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141783.303154:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141783.303160:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521017856:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303183:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521017856:12345-0@lo:400: Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303189:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1783141783.303205:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141783.303208:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141783.303217:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521016960:0@lo:400: 00000100:00100000:1.0:1783141783.303239:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.303263:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521017472:0@lo:400: 00000100:00100000:1.0:1783141783.303310:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.303328:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783141783.303334:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521016576:0@lo:400: 00000100:00100000:1.0:1783141783.303358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.303382:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521017088:0@lo:400: 00000100:00100000:1.0:1783141783.303403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.303418:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521017600:0@lo:400: 00000100:00100000:1.0:1783141783.303448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.303474:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016832 00000100:00100000:1.0:1783141783.303478:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016832 00000100:00100000:1.0:1783141783.303502:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017088 00000100:00100000:1.0:1783141783.303505:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017088 00000100:00100000:1.0:1783141783.303517:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141783.303523:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521016832:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303555:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521016832:12345-0@lo:400: Request processed in 32us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303560:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141783.303572:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783141783.303577:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521017088:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303606:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521017088:12345-0@lo:400: Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303612:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783141783.303628:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017472 00000100:00100000:1.0:1783141783.303631:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017472 00000100:00100000:1.0:1783141783.303657:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017600 00000100:00100000:1.0:1783141783.303660:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017600 00000100:00100000:1.0:1783141783.303677:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141783.303689:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521017472:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303719:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521017472:12345-0@lo:400: Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303725:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141783.303736:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141783.303742:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521017600:12345-0@lo:400: 00000100:00100000:1.0:1783141783.303767:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521017600:12345-0@lo:400: Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.303772:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1783141783.303791:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141783.303813:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521016832:0@lo:400: 00010000:00080000:1.0:1783141783.303826:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43554e00 x1869759521017344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141783.303837:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521017344:0@lo:400: 00010000:00080000:1.0:1783141783.303847:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764a80 x1869759521017856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141783.303868:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521017856:0@lo:400: 00000100:00100000:1.0:1783141783.303881:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521016704:0@lo:400: 00000100:00100000:1.0:1783141783.303889:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521017216:0@lo:400: 00000100:00100000:1.0:1783141783.303899:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521017728:0@lo:400: 00000100:00100000:1.0:1783141783.303938:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521017088:0@lo:400: 00010000:00080000:1.0:1783141783.303948:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43555f80 x1869759521017600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141783.303967:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521017600:0@lo:400: 00010000:00080000:1.0:1783141783.303977:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557800 x1869759521017472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141783.303984:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521017472:0@lo:400: 00000100:00100000:1.0:1783141783.304006:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016960 00000100:00100000:1.0:1783141783.304009:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016960 00000100:00100000:1.0:1783141783.304033:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141783.304039:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521016960:12345-0@lo:400: 00000100:00100000:1.0:1783141783.304072:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521016960:12345-0@lo:400: Request processed in 32us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.304077:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141783.304103:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521016960:0@lo:400: 00000100:00100000:2.0:1783141783.305178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521016576 00000100:00100000:2.0:1783141783.305186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521016576 00000100:00100000:2.0:1783141783.305224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783141783.305232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521016576:12345-0@lo:400: 00000100:00100000:2.0:1783141783.305327:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521016576:12345-0@lo:400: Request processed in 96us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.305346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783141783.305397:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521016576:0@lo:400: 00010000:00010000:2.0:1783141783.430430:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141783.810540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141783.810580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141783.810622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141783.810644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141783.810669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141783.810697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045760 00000100:00100000:2.0:1783141783.810706:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045760 00000100:00100000:2.0:1783141783.810753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00100000:2.0:1783141783.810763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501045760:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783141783.810833:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501045760:12345-192.168.203.39@tcp:400: Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.810840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00100000:2.0:1783141783.810884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501045888 00000100:00100000:2.0:1783141783.810888:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501045888 00000100:00100000:2.0:1783141783.810922:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046016 00000100:00100000:2.0:1783141783.810925:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046016 00000100:00100000:2.0:1783141783.810945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:2.0:1783141783.810951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501045888:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783141783.810981:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501045888:12345-192.168.203.39@tcp:400: Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.810987:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:2.0:1783141783.810999:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:2.0:1783141783.811005:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501046016:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783141783.811047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501046016:12345-192.168.203.39@tcp:400: Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.811053:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:2.0:1783141783.811072:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046144 00000100:00100000:2.0:1783141783.811076:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046144 00000100:00100000:2.0:1783141783.811101:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046272 00000100:00100000:2.0:1783141783.811104:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046272 00000100:00100000:2.0:1783141783.811123:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783141783.811128:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501046144:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783141783.811152:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501046144:12345-192.168.203.39@tcp:400: Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.811157:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783141783.811167:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783141783.811172:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501046272:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783141783.811191:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501046272:12345-192.168.203.39@tcp:400: Request processed in 19us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141783.811196:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00080000:2.0:1783141783.812409:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141783.812415:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141783.812418:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141783.812421:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141783.831873:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141783.831900:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521017984:0@lo:41: 00000100:00100000:0.0:1783141783.831997:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141783.832123:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521017984 00000100:00100000:1.0:1783141783.832132:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521017984 00000100:00100000:1.0:1783141783.832187:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783141783.832197:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521017984:12345-0@lo:41: 00000004:00000024:1.0:1783141783.832230:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783141783.832310:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521017984:12345-0@lo:41: Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141783.832318:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000001:00100000:1.0:1783141783.832364:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000100:00100000:3.0:1783141783.832478:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521017984:0@lo:41: 00000001:02000400:1.0:1783141784.154387:0:10188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783141784.343433:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141784.343458:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521018112:0@lo:13: 00000100:00100000:1.0:1783141784.343523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141784.343723:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521018112 00000100:00100000:2.0:1783141784.343732:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521018112 00000100:00100000:2.0:1783141784.343787:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141784.343797:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521018112:12345-0@lo:13: 00002000:00000024:2.0:1783141784.343824:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141784.343885:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521018112:12345-0@lo:13: Request processed in 89us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141784.343892:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1783141784.343975:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762adc00 x1869759521018112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141784.343994:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521018112:0@lo:13: 00010000:00010000:1.0:1783141784.455968:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141784.837066:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521018240:0@lo:13: 00000100:00100000:1.0:1783141784.837136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141784.837321:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521018240 00000100:00100000:0.0:1783141784.837329:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521018240 00000100:00100000:0.0:1783141784.837378:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783141784.837395:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521018240:12345-0@lo:13: 00002000:00000024:0.0:1783141784.837418:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141784.837477:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521018240:12345-0@lo:13: Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141784.837484:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783141784.837859:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76319c00 x1869759521018240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141784.837880:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521018240:0@lo:13: 00010000:00010000:0.0:1783141785.476893:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141786.502567:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141787.529865:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141787.848323:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb68969c0 20000000:00000080:1.0:1783141787.848339:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c76328c00 uarg=0000000000000000 20000000:01000000:1.0:1783141787.848386:0:10335:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1783141787.848389:0:10335:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1783141787.848392:0:10335:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783141787.848396:0:10335:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783141787.848400:0:10335:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1783141787.848455:0:10335:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783141787.848458:0:10335:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783141787.855429:0:10336:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1783141787.858741:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1783141787.858953:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1783141787.858982:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1783141787.858999:0:10335:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783141787.859002:0:10335:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783141787.861149:0:10337:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1783141787.861559:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1783141787.861591:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1783141787.861608:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1783141787.861619:0:10335:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783141787.861621:0:10335:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783141787.862202:0:10338:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1783141787.862349:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1783141787.862370:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1783141787.862386:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1783141787.862395:0:10335:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783141787.862396:0:10335:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783141787.862812:0:10339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1783141787.862989:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1783141787.863006:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1783141787.863017:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1783141787.863024:0:10335:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783141787.863026:0:10335:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783141787.863366:0:10340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1783141787.863529:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1783141787.863549:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1783141787.863563:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:3.0:1783141787.863578:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783141787.863597:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863624:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863631:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863638:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863645:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cde expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863652:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806cec expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863659:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863738:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863746:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863752:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863762:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863778:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863785:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863903:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.863919:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 9 pid: 6517 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.863932:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018368:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141787.864267:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864311:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 9 pid: 6515 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864320:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018496:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141787.864353:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864360:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 23 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864369:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018624:0@lo:104: 00000100:00100000:3.0:1783141787.864405:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141787.864448:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864456:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864464:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018752:0@lo:104: 00000100:00100000:3.0:1783141787.864485:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141787.864511:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864518:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 23 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864526:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018880:0@lo:104: 00000100:00100000:3.0:1783141787.864557:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141787.864576:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864584:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 23 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864592:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019008:0@lo:104: 00000100:00100000:3.0:1783141787.864613:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141787.864629:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864636:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 23 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864644:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019136:0@lo:104: 00010000:00010000:3.0:1783141787.864699:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864706:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 23 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864714:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019264:0@lo:104: 00010000:00010000:3.0:1783141787.864739:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864745:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 23 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864751:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019392:0@lo:104: 00010000:00010000:3.0:1783141787.864769:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864776:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 23 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864784:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019520:0@lo:104: 00010000:00010000:3.0:1783141787.864888:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.864896:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 23 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.864904:0:10335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019648:0@lo:104: 00000100:00100000:3.0:1783141787.864921:0:10335:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141787.865390:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783141787.865412:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.865426:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.865433:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.865441:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.865448:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.865457:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521018624 00000100:00100000:1.0:1783141787.865463:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521018624 00000100:00100000:1.0:1783141787.865495:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521018752 00000100:00100000:1.0:1783141787.865498:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521018752 00000100:00100000:1.0:1783141787.865520:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521018880 00000100:00100000:1.0:1783141787.865523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521018880 00000100:00100000:1.0:1783141787.865532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019008 00000100:00100000:1.0:1783141787.865534:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019008 00000100:00100000:1.0:1783141787.865542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019136 00000100:00100000:1.0:1783141787.865549:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019136 00000100:00100000:1.0:1783141787.865560:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019264 00000100:00100000:1.0:1783141787.865562:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019264 00000100:00100000:1.0:1783141787.865568:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019392 00000100:00100000:1.0:1783141787.865570:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019392 00000100:00100000:1.0:1783141787.865578:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019520 00000100:00100000:1.0:1783141787.865581:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019520 00000100:00100000:1.0:1783141787.865589:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019648 00000100:00100000:1.0:1783141787.865591:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019648 00000100:00100000:1.0:1783141787.865604:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141787.865611:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:10335:x1869759521018624:12345-0@lo:104: 00010000:00010000:1.0:1783141787.865623:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.865675:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141787.865682:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+11:10335:x1869759521018624:12345-0@lo:104: Request processed in 72us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.865689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141787.865706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141787.865711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:10335:x1869759521018752:12345-0@lo:104: 00010000:00010000:1.0:1783141787.865719:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.865752:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783141787.865757:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+10:10335:x1869759521018752:12345-0@lo:104: Request processed in 47us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.865763:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141787.865776:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783141787.865781:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:10335:x1869759521018880:12345-0@lo:104: 00010000:00010000:1.0:1783141787.865878:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.865908:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783141787.865914:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+9:10335:x1869759521018880:12345-0@lo:104: Request processed in 133us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.865920:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783141787.865933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141787.865939:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76141c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+8:10335:x1869759521019008:12345-0@lo:104: 00010000:00010000:1.0:1783141787.865946:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.865972:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783141787.865977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76141c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+8:10335:x1869759521019008:12345-0@lo:104: Request processed in 39us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.865983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141787.866010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141787.866016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:10335:x1869759521019136:12345-0@lo:104: 00010000:00010000:1.0:1783141787.866023:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866048:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783141787.866052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+7:10335:x1869759521019136:12345-0@lo:104: Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.866057:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141787.866068:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141787.866072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:10335:x1869759521019264:12345-0@lo:104: 00010000:00010000:1.0:1783141787.866084:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866107:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783141787.866111:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:10335:x1869759521019264:12345-0@lo:104: Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.866116:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141787.866127:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141787.866131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:10335:x1869759521019392:12345-0@lo:104: 00010000:00010000:1.0:1783141787.866137:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866159:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783141787.866163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:10335:x1869759521019392:12345-0@lo:104: Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.866169:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141787.866180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141787.866185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:10335:x1869759521019520:12345-0@lo:104: 00010000:00010000:1.0:1783141787.866191:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866214:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1783141787.866218:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:10335:x1869759521019520:12345-0@lo:104: Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.866223:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141787.866233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141787.866238:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:10335:x1869759521019648:12345-0@lo:104: 00010000:00010000:1.0:1783141787.866251:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866304:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1783141787.866309:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:10335:x1869759521019648:12345-0@lo:104: Request processed in 71us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.866315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1783141787.866334:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783141787.866339:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866345:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866349:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866358:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866366:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866372:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866402:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866408:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.866428:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866435:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76344400/0xb31399d6a3806d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866455:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783141787.866458:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866463:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866466:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866472:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866478:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866483:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866496:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866501:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.866514:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866521:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a3806d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866530:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783141787.866533:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866547:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82157200 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866549:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866555:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866560:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866565:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866575:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866580:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.866584:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866590:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c82157200/0xb31399d6a3806d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d39 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866599:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783141787.866602:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866607:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168ee00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866610:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866625:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866632:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866637:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866649:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866655:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.866660:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866666:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168ee00/0xb31399d6a3806d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806d0f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866675:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783141787.866678:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866684:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866686:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866692:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866698:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866709:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866723:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866728:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.866732:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866739:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3e00/0xb31399d6a3806cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866748:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783141787.866752:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866757:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.866760:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.866766:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.866772:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.866778:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.866788:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.867384:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018624:0@lo:104: 00000100:00100000:3.0:1783141787.867394:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018752:0@lo:104: 00000100:00100000:3.0:1783141787.867401:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018880:0@lo:104: 00000100:00100000:3.0:1783141787.867408:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019008:0@lo:104: 00000100:00100000:3.0:1783141787.867415:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019136:0@lo:104: 00000100:00100000:3.0:1783141787.867422:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019264:0@lo:104: 00000100:00100000:3.0:1783141787.867429:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019392:0@lo:104: 00000100:00100000:3.0:1783141787.867435:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019520:0@lo:104: 00000100:00100000:3.0:1783141787.867441:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521019648:0@lo:104: 00010000:00010000:1.0:1783141787.867663:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.867689:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867696:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a3000/0xb31399d6a3806cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ce5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867707:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783141787.867710:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867716:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.867719:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867726:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.867732:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.867737:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.867754:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867760:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.867765:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867771:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2400/0xb31399d6a3806cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806cd7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.867780:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141787.867788:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.867904:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521019776:0@lo:103: 00000100:00100000:3.0:1783141787.867959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141787.868004:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521020288:0@lo:103: 00000100:00100000:3.0:1783141787.868024:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141787.868043:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141787.868048:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521020160:0@lo:103: 00000100:00100000:3.0:1783141787.868066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141787.868128:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019776 00000100:00100000:0.0:1783141787.868136:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019776 00010000:00010000:0.0:1783141787.868164:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 24 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141787.868196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020288 00000100:00100000:0.0:1783141787.868199:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020288 00010000:00010000:0.0:1783141787.868211:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 25 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141787.868222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020160 00000100:00100000:0.0:1783141787.868224:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020160 00010000:00010000:0.0:1783141787.868233:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 26 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141787.868246:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141787.868254:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+26:3653:x1869759521019776:12345-0@lo:103: 00010000:00010000:0.0:1783141787.868265:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141787.868287:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 26 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868298:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 26 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868320:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806d71 expref: 26 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868332:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141787.868367:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3653:x1869759521019776:12345-0@lo:103: Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141787.868374:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141787.868414:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141787.868421:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521020288:12345-0@lo:103: 00010000:00010000:0.0:1783141787.868429:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141787.868433:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868442:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868452:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a3806cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806cec expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868460:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141787.868481:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3653:x1869759521020288:12345-0@lo:103: Request processed in 61us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141787.868486:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141787.868499:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141787.868505:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3653:x1869759521020160:12345-0@lo:103: 00010000:00010000:0.0:1783141787.868513:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141787.868517:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 22 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868532:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 22 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868543:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3a00/0xb31399d6a3806d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806d08 expref: 22 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.868552:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141787.868572:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3653:x1869759521020160:12345-0@lo:103: Request processed in 67us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141787.868577:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141787.868609:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521020160:0@lo:103: 00000100:00100000:0.0:1783141787.868617:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521019776:0@lo:103: 00000100:00100000:0.0:1783141787.868624:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521020288:0@lo:103: 00010000:00010000:1.0:1783141787.868906:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40030000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.868910:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.868917:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.868923:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.868929:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.868959:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.868966:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.868982:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.868989:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869000:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141787.869003:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fe00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:1.0:1783141787.869012:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869030:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141787.869036:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141787.869041:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141787.869055:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869060:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141787.869065:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869071:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a3806c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869083:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141787.869085:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141787.869087:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141787.869094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141787.869112:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521020672:0@lo:103: 00000100:00100000:1.0:1783141787.869142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869170:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141787.869176:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521020800:0@lo:103: 00000100:00100000:1.0:1783141787.869195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869216:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521019904:0@lo:103: 00000100:00100000:1.0:1783141787.869236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869257:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020416:0@lo:103: 00000100:00100000:1.0:1783141787.869298:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869320:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783141787.869325:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020032:0@lo:103: 00000100:00100000:1.0:1783141787.869346:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869354:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020544:0@lo:103: 00000100:00100000:1.0:1783141787.869369:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.869397:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020672 00000100:00100000:1.0:1783141787.869401:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020672 00010000:00010000:1.0:1783141787.869417:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 21 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869432:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020800 00000100:00100000:1.0:1783141787.869434:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020800 00010000:00010000:1.0:1783141787.869443:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 22 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869453:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521019904 00000100:00100000:1.0:1783141787.869455:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521019904 00010000:00010000:1.0:1783141787.869463:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 23 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869471:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020416 00000100:00100000:1.0:1783141787.869472:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020416 00010000:00010000:1.0:1783141787.869479:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020032 00000100:00100000:1.0:1783141787.869488:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020032 00010000:00010000:1.0:1783141787.869495:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 25 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869515:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020544 00000100:00100000:1.0:1783141787.869517:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020544 00010000:00010000:1.0:1783141787.869541:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 26 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141787.869553:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141787.869559:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+26:3652:x1869759521020672:12345-0@lo:103: 00010000:00010000:1.0:1783141787.869567:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141787.869571:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 26 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869579:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 26 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869589:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806c98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806c91 expref: 26 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869598:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141787.869626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3652:x1869759521020672:12345-0@lo:103: Request processed in 66us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.869632:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141787.869645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141787.869650:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521020800:12345-0@lo:103: 00010000:00010000:1.0:1783141787.869657:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141787.869661:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869668:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869684:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a3200/0xb31399d6a3806c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806c67 expref: 24 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869692:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141787.869716:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3652:x1869759521020800:12345-0@lo:103: Request processed in 66us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.869722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141787.869733:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141787.869739:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3654:x1869759521019904:12345-0@lo:103: 00010000:00010000:1.0:1783141787.869745:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141787.869750:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 22 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869758:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 22 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869767:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76345a00/0xb31399d6a3806d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806d4e expref: 22 pid: 6516 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.869774:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141787.869978:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783141787.869987:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3654:x1869759521020416:12345-0@lo:103: 00010000:00010000:3.0:1783141787.869995:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141787.869999:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 21 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.870007:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 21 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.870026:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a3806ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806cde expref: 21 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.870034:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141787.870105:0:9526:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783141787.870114:0:9526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1783141787.870130:0:6509:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783141787.870138:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783141787.870145:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759521020032:12345-0@lo:103: 00010000:00010000:0.0:1783141787.870152:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141787.870157:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 20 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.870165:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 20 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.870175:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c82156400/0xb31399d6a3806d39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806d32 expref: 20 pid: 6517 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141787.870195:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141787.871221:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:3654:x1869759521019904:12345-0@lo:103: Request processed in 1478us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.871232:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141787.871253:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783141787.871262:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141787.871284:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:3654:x1869759521020544:12345-0@lo:103: 00010000:00010000:1.0:1783141787.871310:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141787.871321:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 18 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.871331:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 18 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.871344:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806cd0 expref: 18 pid: 6515 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141787.871358:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141787.871878:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:3654:x1869759521020416:12345-0@lo:103: Request processed in 1891us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141787.871887:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141787.877150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141787.877227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141787.877248:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783141787.877259:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046400 00000100:00100000:2.0:1783141787.877266:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046400 00010000:00010000:2.0:1783141787.877322:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 10 pid: 6517 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141787.877345:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783141787.877351:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046528 00000100:00100000:2.0:1783141787.877353:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046528 00010000:00010000:2.0:1783141787.877363:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 11 pid: 6515 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141787.877374:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783141787.877381:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:2.0:1783141787.877389:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2402:x1869759501046400:12345-192.168.203.39@tcp:103: 00010000:00010000:2.0:1783141787.877403:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141787.877409:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 11 pid: 6517 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877420:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 11 pid: 6517 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877438:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141787.877482:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2402:x1869759501046400:12345-192.168.203.39@tcp:103: Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141787.877507:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:2.0:1783141787.877523:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783141787.877529:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783141787.877534:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501046528:12345-192.168.203.39@tcp:103: 00010000:00010000:2.0:1783141787.877541:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141787.877545:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 10 pid: 6515 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877553:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 10 pid: 6515 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877565:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877574:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877588:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877595:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877602:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877608:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877614:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141787.877624:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877633:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877641:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141787.877650:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141787.877686:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501046528:12345-192.168.203.39@tcp:103: Request processed in 151us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141787.877692:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783141787.878588:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:3654:x1869759521020032:12345-0@lo:103: Request processed in 8439us (9236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141787.878598:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1783141787.879686:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806d94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4b4 expref: 9 pid: 6517 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.879703:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018368:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141787.879717:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806d8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ad expref: 8 pid: 6515 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141787.879724:0:10335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1869759521018496:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141787.879767:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.879775:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.879780:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141787.879786:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806dd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141787.882086:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521020800:0@lo:103: 00000100:00100000:2.0:1783141787.882099:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521020672:0@lo:103: 00000100:00100000:1.0:1783141787.884353:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3654:x1869759521020544:12345-0@lo:103: Request processed in 13076us (14974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.884366:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141787.884414:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020032:0@lo:103: 00000100:00100000:1.0:1783141787.884423:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020544:0@lo:103: 00000100:00100000:1.0:1783141787.884431:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521019904:0@lo:103: 00000100:00100000:1.0:1783141787.884438:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521020416:0@lo:103: 00000100:00100000:1.0:1783141787.909584:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141787.909611:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521020928:0@lo:41: 00000100:00100000:1.0:1783141787.909783:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141787.909861:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521020928 00000100:00100000:1.0:1783141787.909868:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521020928 00000100:00100000:1.0:1783141787.909911:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141787.909919:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521020928:12345-0@lo:41: 00000004:00000024:1.0:1783141787.909948:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141787.909989:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521020928:12345-0@lo:41: Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141787.910009:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141787.910050:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521020928:0@lo:41: 00000100:00100000:3.0:1783141788.422178:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521021184:0@lo:400: 00000100:00100000:0.0:1783141788.422221:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521021440:0@lo:400: 00000100:00100000:1.0:1783141788.422286:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521021056:0@lo:400: 00000100:00100000:2.0:1783141788.422374:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521021312:0@lo:400: 00000100:00100000:0.0:1783141788.425988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.426084:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521021952:0@lo:400: 00000100:00100000:0.0:1783141788.426126:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.427953:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521022464:0@lo:400: 00000100:00100000:0.0:1783141788.428009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.428040:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783141788.428048:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022080:0@lo:400: 00000100:00100000:0.0:1783141788.428075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.428095:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022592:0@lo:400: 00000100:00100000:0.0:1783141788.428116:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.428882:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021440 00000100:00100000:0.0:1783141788.429117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021440 00000100:00100000:0.0:1783141788.429292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021952 00000100:00100000:0.0:1783141788.429296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021952 00000100:00100000:0.0:1783141788.429321:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022464 00000100:00100000:0.0:1783141788.429324:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022464 00000100:00100000:0.0:1783141788.429340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783141788.429349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521021440:12345-0@lo:400: 00000100:00100000:0.0:1783141788.429416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521021440:12345-0@lo:400: Request processed in 67us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.429423:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783141788.429454:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141788.429460:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521021952:12345-0@lo:400: 00000100:00100000:0.0:1783141788.429491:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521021952:12345-0@lo:400: Request processed in 31us (3364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.429497:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141788.429506:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783141788.429512:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521022464:12345-0@lo:400: 00000100:00100000:0.0:1783141788.429536:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521022464:12345-0@lo:400: Request processed in 25us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.429541:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783141788.429564:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022080 00000100:00100000:0.0:1783141788.429568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022080 00000100:00100000:0.0:1783141788.429593:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022592 00000100:00100000:0.0:1783141788.429596:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022592 00000100:00100000:0.0:1783141788.429615:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141788.429621:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022080:12345-0@lo:400: 00000100:00100000:0.0:1783141788.429652:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022080:12345-0@lo:400: Request processed in 32us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.429658:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141788.429683:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141788.429689:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022592:12345-0@lo:400: 00000100:00100000:0.0:1783141788.429717:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022592:12345-0@lo:400: Request processed in 29us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.429723:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783141788.429744:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141788.429748:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141788.429751:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141788.429784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783141788.429811:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43515500 x1869759521022080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141788.429836:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022080:0@lo:400: 00000100:00100000:3.0:1783141788.429841:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521021696:0@lo:13: 00010000:00080000:0.0:1783141788.429855:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514000 x1869759521022592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141788.429865:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022592:0@lo:400: 00010000:00080000:0.0:1783141788.429880:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43516300 x1869759521021952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141788.429881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.429894:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521021952:0@lo:400: 00010000:00080000:0.0:1783141788.429910:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43517100 x1869759521022464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141788.429919:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521022464:0@lo:400: 00000100:00100000:3.0:1783141788.429927:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022208:0@lo:400: 00000100:00100000:0.0:1783141788.429934:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521021440:0@lo:400: 00000100:00100000:3.0:1783141788.429957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141788.429979:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022720:0@lo:400: 00000100:00100000:3.0:1783141788.430001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141788.430007:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021184 00000100:00100000:0.0:1783141788.430011:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021184 00000100:00100000:3.0:1783141788.430033:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141788.430041:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022848:0@lo:13: 00000100:00100000:0.0:1783141788.430049:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783141788.430058:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521021184:12345-0@lo:400: 00000100:00100000:3.0:1783141788.430065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141788.430097:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021696 00000100:00100000:3.0:1783141788.430102:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021696 00000100:00100000:0.0:1783141788.430108:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521021184:12345-0@lo:400: Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.430117:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783141788.430124:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022848 00000100:00100000:3.0:1783141788.430128:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022848 00000100:00100000:3.0:1783141788.430150:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141788.430155:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521021696:12345-0@lo:13: 00000100:00080000:0.0:1783141788.430157:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1783141788.430179:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141788.430183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022208 00000100:00100000:0.0:1783141788.430189:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022208 00000100:00100000:3.0:1783141788.430216:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521021696:12345-0@lo:13: Request processed in 59us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.430219:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022720 00000100:00100000:3.0:1783141788.430224:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141788.430225:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022720 00000100:00100000:3.0:1783141788.430253:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141788.430259:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783141788.430263:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521022848:12345-0@lo:13: 00002000:00000024:3.0:1783141788.430291:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141788.430294:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521022208:12345-0@lo:400: 00000100:00100000:3.0:1783141788.430326:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521022848:12345-0@lo:13: Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141788.430333:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141788.430342:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521022208:12345-0@lo:400: Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.430350:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141788.430370:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783141788.430377:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7631b480 x1869759521022848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141788.430379:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521022720:12345-0@lo:400: 00000100:00100000:3.0:1783141788.430396:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022848:0@lo:13: 00010000:00080000:3.0:1783141788.430404:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43515880 x1869759521022208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141788.430411:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022208:0@lo:400: 00000100:00100000:0.0:1783141788.430425:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521022720:12345-0@lo:400: Request processed in 46us (421us total) trans 0 rc 0/0 00010000:00080000:3.0:1783141788.430426:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43515f80 x1869759521022720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141788.430441:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783141788.430442:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521022720:0@lo:400: 00000100:00100000:3.0:1783141788.430453:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521021184:0@lo:400: 00010000:00080000:3.0:1783141788.430460:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43679500 x1869759521021696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141788.430468:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521021696:0@lo:13: 00000100:00080000:0.0:1783141788.430468:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141788.430935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141788.430959:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521021824:0@lo:400: 00000100:00100000:2.0:1783141788.430984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141788.431012:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521022336:0@lo:400: 00000100:00100000:2.0:1783141788.431033:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141788.431068:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021824 00000100:00100000:2.0:1783141788.431071:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021824 00000100:00100000:2.0:1783141788.431100:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022336 00000100:00100000:2.0:1783141788.431102:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022336 00000100:00100000:2.0:1783141788.431138:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783141788.431144:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521021824:12345-0@lo:400: 00000100:00100000:2.0:1783141788.431188:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521021824:12345-0@lo:400: Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141788.431195:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783141788.431211:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783141788.431218:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521022336:12345-0@lo:400: 00000100:00100000:2.0:1783141788.431244:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521022336:12345-0@lo:400: Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141788.431250:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1783141788.431286:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141788.431306:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521021824:0@lo:400: 00000100:00100000:2.0:1783141788.431321:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521022336:0@lo:400: 00000100:00100000:1.0:1783141788.432031:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141788.432071:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521021568:0@lo:400: 00000100:00100000:1.0:1783141788.432094:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141788.432171:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021056 00000100:00100000:3.0:1783141788.432176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021056 00000100:00100000:3.0:1783141788.432211:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783141788.432217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3655:x1869759521021056:12345-0@lo:400: 00000100:00100000:3.0:1783141788.432263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:3655:x1869759521021056:12345-0@lo:400: Request processed in 45us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141788.432269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783141788.432371:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521021056:0@lo:400: 00000100:00100000:2.0:1783141788.432484:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021312 00000100:00100000:2.0:1783141788.432487:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021312 00000100:00100000:2.0:1783141788.432509:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521021568 00000100:00100000:2.0:1783141788.432512:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521021568 00000100:00100000:2.0:1783141788.432525:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783141788.432531:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521021312:12345-0@lo:400: 00000100:00100000:1.0:1783141788.432533:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783141788.432539:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521021568:12345-0@lo:400: 00000100:00100000:2.0:1783141788.432567:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521021312:12345-0@lo:400: Request processed in 36us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141788.432574:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783141788.432575:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521021568:12345-0@lo:400: Request processed in 37us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141788.432580:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783141788.432640:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521021312:0@lo:400: 00000100:00100000:3.0:1783141788.432663:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521021568:0@lo:400: 00010000:00010000:1.0:1783141788.548669:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141788.933351:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022976:0@lo:41: 00000100:00100000:0.0:1783141788.933425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141788.933572:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521022976 00000100:00100000:2.0:1783141788.933580:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521022976 00000100:00100000:2.0:1783141788.933628:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783141788.933636:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022976:12345-0@lo:41: 00000004:00000024:2.0:1783141788.933669:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783141788.934149:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521022976:12345-0@lo:41: Request processed in 512us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141788.934172:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783141788.934603:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521022976:0@lo:41: 00000100:00100000:2.0:1783141788.935927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141788.936060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141788.936099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141788.936107:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047040 00000100:00100000:1.0:1783141788.936117:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047040 00000100:00100000:1.0:1783141788.936177:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1783141788.936185:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501047040:12345-192.168.203.39@tcp:400: 00000100:00100000:1.0:1783141788.936241:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501047040:12345-192.168.203.39@tcp:400: Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141788.936246:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783141788.941422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046656 00000100:00100000:3.0:1783141788.941464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046656 00000100:00100000:3.0:1783141788.941531:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:3.0:1783141788.941541:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:2401:x1869759501046656:12345-192.168.203.39@tcp:400: 00000100:00100000:3.0:1783141788.941631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:2401:x1869759501046656:12345-192.168.203.39@tcp:400: Request processed in 90us (5531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141788.941638:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00080000:3.0:1783141788.941794:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141788.942950:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141788.945911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141788.946012:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047168 00000100:00100000:1.0:1783141788.946021:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047168 00000100:00100000:1.0:1783141788.946089:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:1.0:1783141788.946098:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501047168:12345-192.168.203.39@tcp:400: 00000100:00100000:1.0:1783141788.946208:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501047168:12345-192.168.203.39@tcp:400: Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141788.946216:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00080000:2.0:1783141788.947835:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141788.947956:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046784 00000100:00100000:0.0:1783141788.947966:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046784 00000100:00100000:0.0:1783141788.948043:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501046912 00000100:00100000:0.0:1783141788.948047:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501046912 00000100:00100000:1.0:1783141788.948059:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783141788.948073:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501046784:12345-192.168.203.39@tcp:400: 00000100:00080000:2.0:1783141788.948096:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141788.948102:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141788.948201:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501046784:12345-192.168.203.39@tcp:400: Request processed in 131us (12281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141788.952988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:0.0:1783141788.953025:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1783141788.953046:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501046912:12345-192.168.203.39@tcp:400: 00000100:00100000:0.0:1783141788.953148:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501046912:12345-192.168.203.39@tcp:400: Request processed in 112us (10202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141788.953156:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:3.0:1783141789.444736:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521023104:0@lo:13: 00000100:00100000:3.0:1783141789.444802:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.444868:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023104 00000100:00100000:0.0:1783141789.444876:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023104 00000100:00100000:0.0:1783141789.444926:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141789.444936:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521023104:12345-0@lo:13: 00002000:00000024:0.0:1783141789.444978:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141789.449450:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521023104:12345-0@lo:13: Request processed in 4506us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.449465:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1783141789.449604:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514000 x1869759521023104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141789.449625:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521023104:0@lo:13: 00010000:00010000:1.0:1783141789.572464:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783141789.764500:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783141789.764509:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c6f70d800 from 48 10000000:01000000:1.0:1783141789.764515:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141789.764563:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.764576:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.764586:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.764609:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023232:0@lo:101: 00000100:00100000:1.0:1783141789.764675:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.764868:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.764998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023232 00000100:00100000:2.0:1783141789.765005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023232 00000100:00100000:2.0:1783141789.765057:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783141789.765066:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+15:6519:x1869759521023232:12345-0@lo:101: 00010000:00010000:2.0:1783141789.765079:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141789.765091:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806dda expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.765112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806dda expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.765121:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806dda expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.765130:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3000, rc 0) 00000100:00100000:2.0:1783141789.765212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023232:12345-0@lo:101: Request processed in 147us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.765219:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783141789.765562:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023232:0@lo:101: 00010000:00010000:1.0:1783141789.765577:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.765602:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.765660:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023360:0@lo:501: 00000100:00100000:1.0:1783141789.765688:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.765755:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.765792:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023360 00000100:00100000:3.0:1783141789.765797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023360 00000100:00100000:3.0:1783141789.765875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1783141789.765884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023360:12345-0@lo:501: 00000100:00100000:3.0:1783141789.765994:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023360:12345-0@lo:501: Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.766001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783141789.766059:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023360:0@lo:501: 00000100:00100000:1.0:1783141789.766085:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023488:0@lo:503: 00000100:00100000:1.0:1783141789.766120:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.766300:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.766498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023488 00000100:00100000:2.0:1783141789.766509:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023488 00000100:00100000:3.0:1783141789.766574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783141789.766583:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023488:12345-0@lo:503: 00000100:00100000:3.0:1783141789.766662:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023488:12345-0@lo:503: Request processed in 80us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.766669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783141789.766743:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023488:0@lo:503: 00000100:00100000:1.0:1783141789.766938:0:10353:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10353:1869759521023616:0@lo:502: 00000100:00100000:1.0:1783141789.766971:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.767097:0:10353:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.767132:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023616 00000100:00100000:0.0:1783141789.767136:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023616 00000100:00100000:0.0:1783141789.767159:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783141789.767166:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:10353:x1869759521023616:12345-0@lo:502: 00000100:00100000:0.0:1783141789.767287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:10353:x1869759521023616:12345-0@lo:502: Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.767293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783141789.767426:0:10353:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10353:1869759521023616:0@lo:502: 00000100:00100000:1.0:1783141789.767456:0:10353:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10353:1869759521023744:0@lo:502: 00000100:00100000:1.0:1783141789.767484:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.767507:0:10353:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.767643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023744 00000100:00100000:0.0:1783141789.767647:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023744 00000100:00100000:0.0:1783141789.767666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783141789.767672:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:10353:x1869759521023744:12345-0@lo:502: 00000100:00100000:0.0:1783141789.767740:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:10353:x1869759521023744:12345-0@lo:502: Request processed in 67us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.767746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783141789.767826:0:10353:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10353:1869759521023744:0@lo:502: 00000040:00080000:1.0:1783141789.767844:0:10353:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783141789.767978:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783141789.767998:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141789.768007:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.768017:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141789.768026:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783141789.768034:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783141789.768037:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783141789.768059:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.768067:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.768076:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141789.768088:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023872:0@lo:101: 00000100:00100000:0.0:1783141789.768114:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.768136:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.768181:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521023872 00000100:00100000:1.0:1783141789.768186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521023872 00000100:00100000:1.0:1783141789.768205:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783141789.768211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+16:6519:x1869759521023872:12345-0@lo:101: 00010000:00010000:1.0:1783141789.768243:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141789.768256:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344400/0xb31399d6a3806def lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806de8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.768311:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344400/0xb31399d6a3806def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806de8 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.768322:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344400/0xb31399d6a3806def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806de8 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.768471:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344400, rc 0) 00000100:00100000:1.0:1783141789.768501:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521023872:12345-0@lo:101: Request processed in 289us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.768507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783141789.768575:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521023872:0@lo:101: 00010000:00010000:0.0:1783141789.768586:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.768595:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141789.768635:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024000:0@lo:501: 00000100:00100000:0.0:1783141789.768658:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.768687:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.768745:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024000 00000100:00100000:1.0:1783141789.768749:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024000 00000100:00100000:1.0:1783141789.768767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783141789.768772:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521024000:12345-0@lo:501: 00000100:00100000:1.0:1783141789.768881:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521024000:12345-0@lo:501: Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.768887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783141789.768947:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024000:0@lo:501: 00000100:00100000:0.0:1783141789.768971:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024128:0@lo:503: 00000100:00100000:0.0:1783141789.769003:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.769023:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.769068:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024128 00000100:00100000:1.0:1783141789.769072:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024128 00000100:00100000:1.0:1783141789.769089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783141789.769094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521024128:12345-0@lo:503: 00000100:00100000:1.0:1783141789.769166:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521024128:12345-0@lo:503: Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.769172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783141789.769451:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024128:0@lo:503: 00000100:00100000:0.0:1783141789.769921:0:10354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10354:1869759521024256:0@lo:502: 00000100:00100000:0.0:1783141789.769956:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.770013:0:10354:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.770045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024256 00000100:00100000:1.0:1783141789.770050:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024256 00000100:00100000:1.0:1783141789.770105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783141789.770111:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:10354:x1869759521024256:12345-0@lo:502: 00000100:00100000:1.0:1783141789.770188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:10354:x1869759521024256:12345-0@lo:502: Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.770195:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783141789.770295:0:10354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10354:1869759521024256:0@lo:502: 00000020:01000000:0.0:1783141789.770315:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141789.770323:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141789.770326:0:10354:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783141789.770341:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783141789.770359:0:10354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10354:1869759521024384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.770389:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.770666:0:10354:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310480 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.770726:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024384 00000100:00100000:2.0:1783141789.770731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024384 00000100:00100000:2.0:1783141789.770753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783141789.770759:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:10354:x1869759521024384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.770844:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:10354:x1869759521024384:12345-0@lo:502:llog_process_th.0 Request processed in 84us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.770851:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1783141789.770925:0:10354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10354:1869759521024384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141789.770943:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141789.770948:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141789.770949:0:10354:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783141789.770953:0:10354:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1783141789.771089:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783141789.771107:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783141789.771115:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.771125:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141789.771134:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783141789.771136:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b728800 from 48 10000000:01000000:2.0:1783141789.771139:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783141789.771161:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.771169:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.771177:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.771191:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.771218:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.771509:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.771551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024512 00000100:00100000:0.0:1783141789.771556:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024512 00000100:00100000:0.0:1783141789.771577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783141789.771584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+17:6519:x1869759521024512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141789.771592:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141789.771603:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806df6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.771622:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806df6 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.771642:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806df6 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.771650:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40030e00, rc 0) 00000100:00100000:0.0:1783141789.771688:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521024512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.771694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783141789.771755:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141789.771767:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.771776:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.771829:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.771854:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.771875:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.771918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024640 00000100:00100000:0.0:1783141789.771923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024640 00000100:00100000:0.0:1783141789.771940:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783141789.771946:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521024640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.772039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521024640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.772046:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783141789.772510:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.772537:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.772572:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.772599:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.772642:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024768 00000100:00100000:0.0:1783141789.772645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024768 00000100:00100000:0.0:1783141789.772664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783141789.772670:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521024768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.772741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521024768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.772748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783141789.772820:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521024768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.773295:0:10355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10355:1869759521024896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.773327:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.773354:0:10355:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.773481:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521024896 00000100:00100000:1.0:1783141789.773485:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521024896 00000100:00100000:1.0:1783141789.773510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783141789.773514:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:10355:x1869759521024896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.773578:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:10355:x1869759521024896:12345-0@lo:502:llog_process_th.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.773582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783141789.773683:0:10355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10355:1869759521024896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.773709:0:10355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10355:1869759521025024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.773736:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.773762:0:10355:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.773803:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025024 00000100:00100000:1.0:1783141789.773807:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025024 00000100:00100000:1.0:1783141789.773841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783141789.773847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:10355:x1869759521025024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.773902:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:10355:x1869759521025024:12345-0@lo:502:llog_process_th.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.773908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783141789.774022:0:10355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10355:1869759521025024:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783141789.774046:0:10355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783141789.774546:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783141789.774564:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783141789.774573:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.774583:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141789.774598:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783141789.774601:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1783141789.774603:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783141789.774624:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.774632:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.774641:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.774656:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.774688:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.774702:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.774758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025152 00000100:00100000:2.0:1783141789.774763:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025152 00000100:00100000:2.0:1783141789.774795:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783141789.774801:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+18:6519:x1869759521025152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141789.774820:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141789.774831:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3806e0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e04 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.774849:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3806e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e04 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.774858:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3806e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e04 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.774866:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2600, rc 0) 00000100:00100000:2.0:1783141789.774894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.774900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783141789.774964:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141789.774976:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.774984:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.775029:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.775052:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.775074:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.775112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025280 00000100:00100000:2.0:1783141789.775117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025280 00000100:00100000:2.0:1783141789.775143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783141789.775150:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.775420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.775427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783141789.775482:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.775506:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.775534:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.775556:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.775584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025408 00000100:00100000:2.0:1783141789.775587:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025408 00000100:00100000:2.0:1783141789.775634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783141789.775638:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.775696:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.775702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783141789.775838:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141789.776586:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10356:1869759521025536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.776627:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141789.776685:0:10356:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.776804:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025536 00000100:00100000:0.0:1783141789.776818:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025536 00000100:00100000:0.0:1783141789.776880:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783141789.776888:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:10356:x1869759521025536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.777033:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:10356:x1869759521025536:12345-0@lo:502:llog_process_th.0 Request processed in 145us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.777046:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783141789.777509:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10356:1869759521025536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141789.777536:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141789.777544:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141789.777546:0:10356:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783141789.777551:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783141789.777571:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10356:1869759521025664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.777606:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141789.777630:0:10356:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.777689:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025664 00000100:00100000:0.0:1783141789.777693:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025664 00000100:00100000:0.0:1783141789.777867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783141789.777875:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:10356:x1869759521025664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.778118:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:10356:x1869759521025664:12345-0@lo:502:llog_process_th.0 Request processed in 243us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.778125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783141789.778261:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10356:1869759521025664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141789.778299:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141789.778304:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141789.778306:0:10356:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783141789.778310:0:10356:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1783141789.778948:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783141789.778971:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783141789.778981:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.778992:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141789.779001:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783141789.779004:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c7b4fc000 from 48 10000000:01000000:2.0:1783141789.779007:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783141789.779031:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.779040:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.779048:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.779064:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.779098:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.779132:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.779215:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025792 00000100:00100000:1.0:1783141789.779220:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025792 00000100:00100000:1.0:1783141789.779264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783141789.779289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:6519:x1869759521025792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141789.779301:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141789.779311:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e12 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.779419:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e12 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.779431:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e12 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.779439:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344200, rc 0) 00000100:00100000:1.0:1783141789.779480:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521025792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.779486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783141789.779584:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141789.779602:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.779611:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.779652:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.779672:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.779697:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.779795:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521025920 00000100:00100000:3.0:1783141789.779799:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521025920 00000100:00100000:3.0:1783141789.779844:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783141789.779850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521025920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141789.779944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521025920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.779950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783141789.780375:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521025920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.780400:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.780433:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.780457:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.780582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026048 00000100:00100000:3.0:1783141789.780586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026048 00000100:00100000:3.0:1783141789.780616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783141789.780622:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521026048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141789.780711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521026048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.780722:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783141789.781041:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.782650:0:10357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10357:1869759521026176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.782717:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.782761:0:10357:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.782763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026176 00000100:00100000:3.0:1783141789.782771:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026176 00000100:00100000:3.0:1783141789.782827:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783141789.782836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:10357:x1869759521026176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.782964:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:10357:x1869759521026176:12345-0@lo:502:llog_process_th.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.782971:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783141789.783073:0:10357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10357:1869759521026176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.783111:0:10357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10357:1869759521026304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.783142:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.783164:0:10357:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.783203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026304 00000100:00100000:1.0:1783141789.783209:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026304 00000100:00100000:1.0:1783141789.783250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783141789.783257:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:10357:x1869759521026304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.783511:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:10357:x1869759521026304:12345-0@lo:502:llog_process_th.0 Request processed in 254us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.783518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783141789.783591:0:10357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10357:1869759521026304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783141789.783609:0:10357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783141789.783679:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783141789.783712:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141789.783723:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.783738:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141789.783749:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783141789.783752:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1783141789.783755:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783141789.783778:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.783786:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.783795:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141789.783808:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.783855:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.783889:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.783967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026432 00000100:00100000:1.0:1783141789.783977:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026432 00000100:00100000:1.0:1783141789.784008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783141789.784015:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521026432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141789.784023:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141789.784034:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e20 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.784052:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e20 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.784062:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e20 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.784070:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344a00, rc 0) 00000100:00100000:1.0:1783141789.784102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521026432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.784109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783141789.784138:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141789.784152:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.784162:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141789.784209:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.784247:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.784290:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.784297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026560 00000100:00100000:3.0:1783141789.784301:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026560 00000100:00100000:3.0:1783141789.784320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783141789.784324:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521026560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141789.784451:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521026560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.784458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783141789.784484:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.784514:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.784608:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.784635:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.784655:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026688 00000100:00100000:2.0:1783141789.784665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026688 00000100:00100000:2.0:1783141789.784694:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783141789.784699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521026688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.784768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521026688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.784775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783141789.784798:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521026688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.785390:0:10358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10358:1869759521026816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.785427:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.785497:0:10358:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.788223:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026816 00000100:00100000:3.0:1783141789.788236:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026816 00000100:00100000:3.0:1783141789.788352:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783141789.788362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10358:x1869759521026816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.788856:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10358:x1869759521026816:12345-0@lo:502:llog_process_th.0 Request processed in 494us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.788864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783141789.789525:0:10358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10358:1869759521026816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141789.789559:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141789.789568:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141789.789570:0:10358:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783141789.789575:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783141789.789613:0:10358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10358:1869759521026944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.789658:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.789690:0:10358:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141789.790026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521026944 00000100:00100000:1.0:1783141789.790032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521026944 00000100:00100000:1.0:1783141789.790079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783141789.790088:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10358:x1869759521026944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.790188:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10358:x1869759521026944:12345-0@lo:502:llog_process_th.0 Request processed in 101us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141789.790196:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783141789.790263:0:10358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10358:1869759521026944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141789.790311:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141789.790316:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141789.790318:0:10358:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783141789.790322:0:10358:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1783141789.790523:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1783141789.790554:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783141789.790563:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.790584:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141789.790593:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783141789.790595:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c4bd6c000 from 48 10000000:01000000:1.0:1783141789.790598:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141789.790619:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.790627:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.790635:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.790649:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.790678:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.790713:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.790792:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027072 00000100:00100000:0.0:1783141789.790797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027072 00000100:00100000:0.0:1783141789.790837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783141789.790844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521027072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141789.790852:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141789.790863:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40031600/0xb31399d6a3806e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e2e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.790882:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40031600/0xb31399d6a3806e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e2e expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.790892:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40031600/0xb31399d6a3806e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e2e expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141789.790900:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40031600, rc 0) 00000100:00100000:0.0:1783141789.790928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.790935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1783141789.791457:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141789.791473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.791481:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.791530:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.791568:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.791593:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.791803:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027200 00000100:00100000:0.0:1783141789.791807:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027200 00000100:00100000:0.0:1783141789.791850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783141789.791863:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.791976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.791983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783141789.792292:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.792321:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.792829:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.792859:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.792977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027328 00000100:00100000:0.0:1783141789.792983:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027328 00000100:00100000:0.0:1783141789.793019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783141789.793026:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.793109:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.793116:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1783141789.794156:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.794790:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10359:1869759521027456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.794855:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.794900:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.795134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027456 00000100:00100000:3.0:1783141789.795141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027456 00000100:00100000:3.0:1783141789.795188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783141789.795196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10359:x1869759521027456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.795317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10359:x1869759521027456:12345-0@lo:502:llog_process_th.0 Request processed in 121us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.795325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783141789.795914:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10359:1869759521027456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.796183:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10359:1869759521027584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.796222:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.796258:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c42a94600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.796351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027584 00000100:00100000:3.0:1783141789.796356:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027584 00000100:00100000:3.0:1783141789.796387:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783141789.796394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10359:x1869759521027584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141789.796509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10359:x1869759521027584:12345-0@lo:502:llog_process_th.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.796516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783141789.796566:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10359:1869759521027584:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783141789.796584:0:10359:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783141789.797233:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783141789.797253:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783141789.797263:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.797397:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141789.797407:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783141789.797410:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1783141789.797413:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783141789.797436:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.797444:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.797453:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.797469:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.797502:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.797563:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.797601:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027712 00000100:00100000:3.0:1783141789.797605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027712 00000100:00100000:3.0:1783141789.797636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783141789.797644:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521027712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141789.797653:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141789.797664:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e3c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.797685:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e3c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.797695:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e3c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.797704:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc800, rc 0) 00000100:00100000:3.0:1783141789.797777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521027712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.797790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783141789.797892:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141789.797904:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141789.797913:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.798190:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.798215:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141789.798298:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.798394:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027840 00000100:00100000:3.0:1783141789.798398:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027840 00000100:00100000:3.0:1783141789.798456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783141789.798462:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521027840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141789.798571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521027840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.798578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783141789.798630:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.798656:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.798694:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.798858:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.798883:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521027968 00000100:00100000:2.0:1783141789.798887:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521027968 00000100:00100000:2.0:1783141789.798907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783141789.798913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521027968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141789.799016:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521027968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.799022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783141789.799090:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521027968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.799935:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10360:1869759521028096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.799981:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.800018:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141789.800100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028096 00000100:00100000:2.0:1783141789.800105:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028096 00000100:00100000:2.0:1783141789.800139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783141789.800145:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10360:x1869759521028096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141789.800239:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10360:x1869759521028096:12345-0@lo:502:llog_process_th.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141789.800246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783141789.800406:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10360:1869759521028096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141789.800430:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141789.800445:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141789.800447:0:10360:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783141789.800455:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783141789.800474:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10360:1869759521028224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141789.800506:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.800521:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c42a94600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.800631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028224 00000100:00100000:0.0:1783141789.800636:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028224 00000100:00100000:0.0:1783141789.800823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783141789.800831:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10360:x1869759521028224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141789.800918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10360:x1869759521028224:12345-0@lo:502:llog_process_th.0 Request processed in 83us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.800925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783141789.801080:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10360:1869759521028224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141789.801105:0:10360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141789.801110:0:10360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141789.801111:0:10360:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783141789.801116:0:10360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783141789.801163:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1783141789.801181:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783141789.801189:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.801199:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141789.801208:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783141789.801210:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9c48c28000 from 1 10000000:01000000:1.0:1783141789.801213:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783141789.801234:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.801243:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.801257:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.801323:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521028352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.801359:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.803265:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141789.803388:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028352 00000100:00100000:3.0:1783141789.803396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028352 00000100:00100000:3.0:1783141789.803580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1783141789.803590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521028352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141789.803605:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141789.803621:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424ccc00/0xb31399d6a3806e51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e4a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.803645:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424ccc00/0xb31399d6a3806e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e4a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.803656:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424ccc00/0xb31399d6a3806e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e4a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141789.803664:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424ccc00, rc 0) 00000100:00100000:3.0:1783141789.803770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521028352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141789.803779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783141789.804221:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521028352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141789.804383:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.804394:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141789.804551:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141789.804584:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141789.804623:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141789.804666:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028480 00000100:00100000:0.0:1783141789.804671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028480 00000100:00100000:0.0:1783141789.804762:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783141789.804771:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521028480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141789.804868:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521028480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (283us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141789.804888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783141789.804957:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521028480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783141789.804993:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783141789.805000:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141789.805008:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141789.958399:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141789.958420:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521028608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141789.958485:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141789.959211:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028608 00000100:00100000:0.0:1783141789.959220:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028608 00000100:00100000:0.0:1783141789.959300:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783141789.959309:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521028608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141789.959332:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141789.959394:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521028608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141789.959402:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783141789.959480:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76318380 x1869759521028608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141789.959500:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521028608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141790.468947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141790.469023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047296 00000100:00100000:3.0:1783141790.469047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047296 00000100:00100000:3.0:1783141790.469105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:3.0:1783141790.469117:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:6171:x1869759501047296:12345-192.168.203.39@tcp:101: 00010000:00010000:3.0:1783141790.469134:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141790.469154:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cc200/0xb31399d6a3806e58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e524 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.469184:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cc200/0xb31399d6a3806e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e524 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.469195:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cc200/0xb31399d6a3806e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e524 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.469205:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc200, rc 0) 00000100:00100000:3.0:1783141790.469263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047296:12345-192.168.203.39@tcp:101: Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.469295:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:2.0:1783141790.479783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141790.479867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047424 00000100:00100000:0.0:1783141790.479877:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047424 00000100:00100000:0.0:1783141790.479937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 243 00000100:00100000:0.0:1783141790.479947:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047424:12345-192.168.203.39@tcp:501: 00000100:00100000:0.0:1783141790.480104:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047424:12345-192.168.203.39@tcp:501: Request processed in 157us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141790.480112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 243 00000100:00100000:2.0:1783141790.487266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141790.487389:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047552 00000100:00100000:0.0:1783141790.487399:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047552 00000100:00100000:0.0:1783141790.487471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:0.0:1783141790.487482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047552:12345-192.168.203.39@tcp:503: 00000100:00100000:0.0:1783141790.487620:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047552:12345-192.168.203.39@tcp:503: Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141790.487629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:1.0:1783141790.499095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141790.499602:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047680 00000100:00100000:3.0:1783141790.499612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047680 00000100:00100000:3.0:1783141790.499732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:3.0:1783141790.499743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6661:x1869759501047680:12345-192.168.203.39@tcp:502: 00000100:00100000:3.0:1783141790.499927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6661:x1869759501047680:12345-192.168.203.39@tcp:502: Request processed in 184us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.499936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:2.0:1783141790.503074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141790.503193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047808 00000100:00100000:1.0:1783141790.503207:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047808 00000100:00100000:1.0:1783141790.503430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:1.0:1783141790.503441:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6661:x1869759501047808:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141790.503713:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6661:x1869759501047808:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 272us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141790.503722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:2.0:1783141790.506704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141790.506973:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501047936 00000100:00100000:3.0:1783141790.506984:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501047936 00000100:00100000:3.0:1783141790.507039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 247 00000100:00100000:3.0:1783141790.507048:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501047936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141790.507079:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141790.507097:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cd800/0xb31399d6a3806e5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e52b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.507125:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cd800/0xb31399d6a3806e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e52b expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.507137:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cd800/0xb31399d6a3806e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e52b expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141790.507147:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd800, rc 0) 00000100:00100000:3.0:1783141790.507200:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501047936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 153us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.507212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 247 00000100:00100000:2.0:1783141790.513471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141790.513695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048064 00000100:00100000:1.0:1783141790.513705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048064 00000100:00100000:1.0:1783141790.513776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 248 00000100:00100000:1.0:1783141790.513787:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141790.513921:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 135us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141790.513930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 248 00010000:00010000:1.0:1783141790.597907:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141791.620382:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141791.733686:0:10398:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd56b4ce50 20000000:00000080:1.0:1783141791.733703:0:10398:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9b43684800 uarg=0000000000000000 20000000:01000000:1.0:1783141791.733740:0:10398:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783141791.733746:0:10398:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783141791.733751:0:10398:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783141791.734160:0:10399:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783141791.734376:0:10398:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1783141791.737936:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1783141791.737972:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1783141791.737987:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1783141791.738003:0:10398:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783141791.738020:0:10398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738039:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738062:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806afb expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738069:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738077:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738087:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738096:0:10398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738133:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738148:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 9 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.738163:0:10398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028736:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141791.738650:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738660:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 23 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.738669:0:10398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028864:0@lo:104: 00000100:00100000:1.0:1783141791.738714:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141791.738744:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738753:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 23 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.738760:0:10398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028992:0@lo:104: 00000100:00100000:1.0:1783141791.738779:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141791.738809:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738818:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 23 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.738825:0:10398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521029120:0@lo:104: 00010000:00010000:1.0:1783141791.738846:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.738853:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 23 pid: 6515 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.738860:0:10398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521029248:0@lo:104: 00000100:00100000:1.0:1783141791.738872:0:10398:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141791.739057:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141791.739074:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.739092:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.739100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028864 00000100:00100000:0.0:1783141791.739107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028864 00000100:00100000:0.0:1783141791.739140:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521028992 00000100:00100000:0.0:1783141791.739142:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521028992 00000100:00100000:0.0:1783141791.739151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029120 00000100:00100000:0.0:1783141791.739153:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029120 00000100:00100000:0.0:1783141791.739160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029248 00000100:00100000:0.0:1783141791.739162:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029248 00000100:00100000:0.0:1783141791.739172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783141791.739179:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:10398:x1869759521028864:12345-0@lo:104: 00010000:00010000:0.0:1783141791.739191:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739253:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141791.739259:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:10398:x1869759521028864:12345-0@lo:104: Request processed in 80us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.739266:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783141791.739305:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783141791.739311:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76329050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:10398:x1869759521028992:12345-0@lo:104: 00010000:00010000:0.0:1783141791.739318:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739348:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141791.739353:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76329050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:10398:x1869759521028992:12345-0@lo:104: Request processed in 44us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.739359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783141791.739390:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141791.739397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:10398:x1869759521029120:12345-0@lo:104: 00010000:00010000:0.0:1783141791.739412:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739437:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783141791.739442:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:10398:x1869759521029120:12345-0@lo:104: Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.739448:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141791.739459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141791.739465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:10398:x1869759521029248:12345-0@lo:104: 00010000:00010000:0.0:1783141791.739472:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739494:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783141791.739500:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:10398:x1869759521029248:12345-0@lo:104: Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.739505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1783141791.739523:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783141791.739529:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739536:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40030600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141791.739541:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739550:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141791.739558:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141791.739583:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141791.739606:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739612:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141791.739632:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739639:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806c83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806c8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739653:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141791.739656:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739662:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141791.739665:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739672:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141791.739679:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141791.739686:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141791.739695:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739701:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141791.739721:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739728:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2000/0xb31399d6a3806b5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b64 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739738:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141791.739741:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739747:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2c00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141791.739751:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739757:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141791.739764:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141791.739770:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141791.739781:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739787:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141791.739792:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739811:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3806afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806b02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739819:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141791.739827:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739833:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141791.739837:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739844:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141791.739850:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141791.739856:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141791.739867:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739873:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141791.739879:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739884:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a3806aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806aae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.739896:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141791.739897:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141791.739899:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141791.739906:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141791.739917:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521029376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.739945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.739966:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141791.739977:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521029760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.739997:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.740020:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521029504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.740038:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.740052:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141791.740057:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521029632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.740076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141791.740097:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029376 00000100:00100000:0.0:1783141791.740100:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029376 00010000:00010000:0.0:1783141791.740118:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 24 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.740137:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029760 00000100:00100000:0.0:1783141791.740140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029760 00010000:00010000:0.0:1783141791.740149:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 25 pid: 6515 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.740158:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029504 00000100:00100000:0.0:1783141791.740160:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029504 00010000:00010000:0.0:1783141791.740168:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 26 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.740177:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029632 00000100:00100000:0.0:1783141791.740179:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029632 00010000:00010000:0.0:1783141791.740187:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 27 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.740198:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141791.740203:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+27:3653:x1869759521029376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141791.740213:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141791.740222:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 27 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740232:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 27 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740246:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141791.740289:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+27:3653:x1869759521029376:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.740296:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141791.740309:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141791.740315:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+26:3653:x1869759521029760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141791.740322:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141791.740326:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 26 pid: 6515 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740335:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 26 pid: 6515 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740343:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141791.740363:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+26:3653:x1869759521029760:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.740369:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141791.740380:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141791.740386:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3654:x1869759521029504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141791.740394:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141791.740397:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 25 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740413:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 25 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740422:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141791.740447:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3654:x1869759521029504:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.740453:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141791.740466:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141791.740472:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521029632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141791.740479:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141791.740483:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 24 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740490:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 24 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.740498:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141791.740517:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521029632:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.740523:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141791.740574:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521029632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.740581:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521029504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.740602:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521029760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141791.740609:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521029376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141791.740947:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806c8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806c83 expref: 23 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.740960:0:10398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028864:0@lo:104: 00010000:00010000:1.0:1783141791.740968:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806b64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806b5d expref: 22 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.740987:0:10398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028992:0@lo:104: 00010000:00010000:1.0:1783141791.740997:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806b02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806afb expref: 21 pid: 6516 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.741004:0:10398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521029120:0@lo:104: 00010000:00010000:1.0:1783141791.741011:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3806aae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806aa7 expref: 20 pid: 6515 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141791.741018:0:10398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521029248:0@lo:104: 00000100:00100000:2.0:1783141791.744631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141791.744847:0:10398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1869759521028736:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141791.744897:0:10398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.744981:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048192 00000100:00100000:0.0:1783141791.745001:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048192 00010000:00010000:0.0:1783141791.745042:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141791.745074:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:0.0:1783141791.745082:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501048192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141791.745096:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141791.745102:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745112:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745128:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76345800/0xb31399d6a3806da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4ec expref: 10 pid: 6515 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745143:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745151:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745164:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745171:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745179:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745202:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745208:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141791.745211:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745219:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745238:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141791.745254:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141791.745320:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:2402:x1869759501048192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 237us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.745328:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00010000:00010000:1.0:1783141791.745389:0:10398:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.745397:0:10398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141791.745403:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344000/0xb31399d6a3806e66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141791.789224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141791.789379:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048320 00000100:00100000:3.0:1783141791.789388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048320 00000100:00100000:3.0:1783141791.789436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:3.0:1783141791.789447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:6171:x1869759501048320:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141791.789463:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141791.789481:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e532 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141791.789508:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141791.789520:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141791.789544:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cdc00, rc 0) 00000100:00100000:3.0:1783141791.789599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048320:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 154us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141791.789607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:1.0:1783141791.798812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141791.798848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048448 00000100:00100000:1.0:1783141791.798856:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048448 00000100:00100000:1.0:1783141791.798911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:1.0:1783141791.798919:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048448:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141791.799064:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048448:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 145us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141791.799072:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:3.0:1783141791.804729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141791.805027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048576 00000100:00100000:1.0:1783141791.805037:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048576 00000100:00100000:1.0:1783141791.805083:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:1.0:1783141791.805093:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048576:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141791.805227:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6171:x1869759501048576:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 135us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141791.805236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:3.0:1783141791.822406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141791.822496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048704 00000100:00100000:0.0:1783141791.822506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048704 00000100:00100000:0.0:1783141791.822567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:0.0:1783141791.822577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6686:x1869759501048704:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141791.822706:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6686:x1869759501048704:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141791.822716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:2.0:1783141791.837904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141791.837981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048832 00000100:00100000:3.0:1783141791.837990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048832 00000100:00100000:3.0:1783141791.838050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 253 00000100:00100000:3.0:1783141791.838060:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6686:x1869759501048832:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141791.838195:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:6686:x1869759501048832:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 135us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141791.838203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 253 00010000:00010000:0.0:1783141792.644842:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783141792.964331:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141792.964339:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f70d800 from 4 10000000:01000000:1.0:1783141792.964344:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141792.964385:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141792.964398:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141792.964408:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141792.964432:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521029888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141792.964496:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141792.964543:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141792.964632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521029888 00000100:00100000:3.0:1783141792.964639:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521029888 00000100:00100000:3.0:1783141792.964692:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783141792.964701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521029888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141792.964714:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141792.964725:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e74 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.964745:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.964756:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.964775:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc600, rc 0) 00000100:00100000:3.0:1783141792.964825:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521029888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141792.964841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783141792.965125:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521029888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141792.965748:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141792.965767:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141792.965853:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141792.965893:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.965976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030016 00000100:00100000:2.0:1783141792.965982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030016 00000100:00100000:2.0:1783141792.966029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783141792.966037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521030016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.966159:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521030016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.966166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783141792.967130:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141792.967287:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141792.967330:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141792.967383:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141792.967405:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c5c5300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141792.967576:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030144 00000100:00100000:3.0:1783141792.967582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030144 00000100:00100000:3.0:1783141792.967624:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783141792.967633:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521030144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141792.967729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521030144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141792.967738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783141792.969012:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.969441:0:10462:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10462:1869759521030272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141792.969568:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141792.969609:0:10462:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.969685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030272 00000100:00100000:2.0:1783141792.969691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030272 00000100:00100000:2.0:1783141792.969783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783141792.969802:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10462:x1869759521030272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.969942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10462:x1869759521030272:12345-0@lo:502:llog_process_th.0 Request processed in 140us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.969949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783141792.972326:0:10462:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10462:1869759521030272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141792.972374:0:10462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141792.972386:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141792.972388:0:10462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783141792.972399:0:10462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6f70d800 00000020:00000080:3.0:1783141792.972403:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783141792.976259:0:10462:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10462:1869759521030400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141792.976350:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141792.976387:0:10462:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.977399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030400 00000100:00100000:2.0:1783141792.977409:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030400 00000100:00100000:2.0:1783141792.977459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783141792.977468:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10462:x1869759521030400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.977599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:10462:x1869759521030400:12345-0@lo:502:llog_process_th.0 Request processed in 131us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.977609:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783141792.977633:0:10462:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10462:1869759521030400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141792.977665:0:10462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141792.977673:0:10462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141792.977680:0:10462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783141792.977688:0:10462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783141792.978984:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783141792.979015:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141792.979026:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.979039:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141792.979049:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783141792.979052:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b728800 from 4 10000000:01000000:2.0:1783141792.979055:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141792.979086:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.979093:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.979102:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141792.979121:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.979193:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.979500:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141792.979757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030528 00000100:00100000:3.0:1783141792.979764:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030528 00000100:00100000:3.0:1783141792.979821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783141792.979831:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521030528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141792.979852:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141792.979865:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e82 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.979899:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.979910:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141792.979918:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cde00, rc 0) 00000100:00100000:3.0:1783141792.979958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521030528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141792.979964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783141792.981031:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141792.981050:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.981061:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141792.981130:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.981418:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.981454:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.981471:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030656 00000100:00100000:2.0:1783141792.981476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030656 00000100:00100000:2.0:1783141792.981509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783141792.981516:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521030656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.981619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521030656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.981627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783141792.981662:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.981688:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.981734:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.981749:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.981762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030784 00000100:00100000:2.0:1783141792.981766:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030784 00000100:00100000:2.0:1783141792.981802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783141792.981809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521030784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.981922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521030784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.981929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783141792.981972:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521030784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.982153:0:10465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10465:1869759521030912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.982207:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.982228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521030912 00000100:00100000:2.0:1783141792.982232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521030912 00000100:00100000:2.0:1783141792.982290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783141792.982298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10465:x1869759521030912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.982367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10465:x1869759521030912:12345-0@lo:502:llog_process_th.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.982374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1783141792.982403:0:10465:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a43dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.982416:0:10465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10465:1869759521030912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141792.982438:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141792.982448:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141792.982450:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783141792.982459:0:10465:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c7b728800 00000020:00000080:2.0:1783141792.982462:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783141792.982532:0:10465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10465:1869759521031040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.982567:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.982586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031040 00000100:00100000:2.0:1783141792.982590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031040 00000100:00100000:2.0:1783141792.983469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141792.983483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10465:x1869759521031040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.983571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:10465:x1869759521031040:12345-0@lo:502:llog_process_th.0 Request processed in 92us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.983578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141792.983616:0:10465:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.983632:0:10465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10465:1869759521031040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141792.983652:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141792.983658:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141792.983660:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783141792.983665:0:10465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783141792.983715:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783141792.983730:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141792.983738:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.983748:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141792.983759:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783141792.983761:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b4fc000 from 4 10000000:01000000:2.0:1783141792.983764:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141792.983786:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.983806:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.983815:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141792.983831:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.983879:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.984069:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.984084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031168 00000100:00100000:2.0:1783141792.984088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031168 00000100:00100000:2.0:1783141792.984115:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141792.984120:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521031168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141792.984128:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141792.984140:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.984160:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.984298:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.984309:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:2.0:1783141792.984341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.984348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141792.984381:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141792.984394:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141792.984402:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141792.984443:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.984475:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.984494:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.984505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031296 00000100:00100000:2.0:1783141792.984508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031296 00000100:00100000:2.0:1783141792.984530:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783141792.984537:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.984619:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.984625:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783141792.984653:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.984679:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.984714:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141792.984728:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.984739:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031424 00000100:00100000:2.0:1783141792.984742:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031424 00000100:00100000:2.0:1783141792.984762:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783141792.984769:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141792.989111:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4332us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.989125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783141792.989216:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141792.993953:0:10467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10467:1869759521031552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141792.994037:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141792.994100:0:10467:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141792.994268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031552 00000100:00100000:3.0:1783141792.994298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031552 00000100:00100000:3.0:1783141792.994345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783141792.994354:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10467:x1869759521031552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141792.994467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10467:x1869759521031552:12345-0@lo:502:llog_process_th.0 Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141792.994474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783141792.995042:0:10467:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10467:1869759521031552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141792.995073:0:10467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141792.995081:0:10467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141792.995084:0:10467:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783141792.995091:0:10467:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c7b4fc000 00000020:00000080:0.0:1783141792.995094:0:10467:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783141792.995174:0:10467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10467:1869759521031680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141792.995212:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141792.995243:0:10467:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141792.996475:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031680 00000100:00100000:2.0:1783141792.996487:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031680 00000100:00100000:2.0:1783141792.996543:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783141792.996554:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10467:x1869759521031680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141792.996690:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:10467:x1869759521031680:12345-0@lo:502:llog_process_th.0 Request processed in 138us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141792.996699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783141792.999470:0:10467:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10467:1869759521031680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141792.999512:0:10467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141792.999520:0:10467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141792.999522:0:10467:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783141792.999527:0:10467:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783141793.000688:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783141793.000714:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141793.000735:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141793.000746:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141793.000825:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783141793.000828:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c4bd6c000 from 4 10000000:01000000:3.0:1783141793.000831:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141793.000987:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141793.000995:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141793.001007:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141793.001030:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.001095:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.001145:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141793.001155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031808 00000100:00100000:1.0:1783141793.001163:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031808 00000100:00100000:1.0:1783141793.001205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783141793.001213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521031808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141793.001225:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141793.001238:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806e9e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141793.001260:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141793.001342:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141793.001363:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76345200, rc 0) 00000100:00100000:1.0:1783141793.001406:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521031808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141793.001413:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783141793.002692:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141793.002712:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141793.002724:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141793.002803:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.002992:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.003027:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141793.003045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521031936 00000100:00100000:3.0:1783141793.003050:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521031936 00000100:00100000:3.0:1783141793.003085:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783141793.003093:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521031936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.003417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521031936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.003426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783141793.003459:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.003488:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521032064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.003525:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.003548:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141793.003562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032064 00000100:00100000:3.0:1783141793.003566:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032064 00000100:00100000:3.0:1783141793.003593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783141793.003601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521032064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.003675:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521032064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.003682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783141793.003725:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521032064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141793.004430:0:10469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10469:1869759521032192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141793.004473:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.004493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032192 00000100:00100000:3.0:1783141793.004503:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032192 00000100:00100000:3.0:1783141793.004528:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783141793.004534:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:10469:x1869759521032192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141793.004611:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:10469:x1869759521032192:12345-0@lo:502:llog_process_th.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.004618:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783141793.004660:0:10469:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141793.004673:0:10469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10469:1869759521032192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141793.004695:0:10469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141793.004704:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141793.004706:0:10469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783141793.004717:0:10469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c4bd6c000 00000020:00000080:3.0:1783141793.004720:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783141793.006504:0:10469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10469:1869759521032320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141793.007165:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.008565:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032320 00000100:00100000:3.0:1783141793.008655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032320 00000100:00100000:3.0:1783141793.008740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783141793.008755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:10469:x1869759521032320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141793.009689:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:10469:x1869759521032320:12345-0@lo:502:llog_process_th.0 Request processed in 935us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.009700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783141793.009784:0:10469:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141793.009824:0:10469:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:10469:1869759521032320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141793.009941:0:10469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141793.009949:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141793.009958:0:10469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783141793.009967:0:10469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783141793.010075:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783141793.010093:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141793.010103:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141793.010112:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141793.031208:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141793.031228:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521032448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141793.031310:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141793.031349:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032448 00000100:00100000:3.0:1783141793.031356:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032448 00000100:00100000:3.0:1783141793.031396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141793.031405:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521032448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141793.031435:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141793.031492:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521032448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.031499:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141793.031534:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521032448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141793.541420:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521032576:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.541425:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521032832:0@lo:400:kworker.0 00000100:00100000:2.0:1783141793.541590:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521032704:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.544134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141793.544150:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.544930:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521033344:0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545018:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141793.545041:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521033088:0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141793.545395:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521033600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141793.545553:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032832 00000100:00100000:0.0:1783141793.545561:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032832 00000100:00100000:0.0:1783141793.545598:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032576 00000100:00100000:0.0:1783141793.545601:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032576 00000100:00100000:0.0:1783141793.545613:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033088 00000100:00100000:0.0:1783141793.545615:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033088 00000100:00100000:0.0:1783141793.545637:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033600 00000100:00100000:0.0:1783141793.545645:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033600 00000100:00100000:0.0:1783141793.545667:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141793.545675:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521032832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545720:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521032832:12345-0@lo:400:kworker.0 Request processed in 46us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.545727:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141793.545744:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141793.545750:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521032576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545779:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521032576:12345-0@lo:400:kworker.0 Request processed in 29us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.545794:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141793.545806:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783141793.545812:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.545840:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521033088:12345-0@lo:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.545846:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783141793.545983:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141793.545990:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521033600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.546020:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521033600:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.546027:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141793.546052:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521034112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141793.546260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141793.546322:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521032576:0@lo:400:kworker.0 00010000:00080000:0.0:1783141793.546402:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6ddc00 x1869759521033088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141793.546419:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521033088:0@lo:400:kworker.0 00010000:00080000:0.0:1783141793.546429:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557100 x1869759521033600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141793.546437:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521033600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.546574:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034112 00000100:00100000:0.0:1783141793.546579:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034112 00000100:00100000:0.0:1783141793.546607:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141793.546614:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521034112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141793.546634:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141793.546667:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521034112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.546673:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1783141793.546697:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762adc00 x1869759521034112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141793.546709:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521034112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141793.547002:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521033216:0@lo:400:kworker.0 00000100:00100000:2.0:1783141793.547030:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141793.547161:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521033728:0@lo:400:kworker.0 00000100:00100000:2.0:1783141793.547191:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141793.547708:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032704 00000100:00100000:2.0:1783141793.547713:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032704 00000100:00100000:2.0:1783141793.547744:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783141793.547749:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141793.547801:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521032704:12345-0@lo:400:kworker.0 Request processed in 52us (3650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141793.547808:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1783141793.547825:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141793.547828:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141793.547973:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033216 00000100:00100000:0.0:1783141793.547977:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033216 00000100:00100000:0.0:1783141793.548008:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033728 00000100:00100000:0.0:1783141793.548011:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033728 00000100:00100000:0.0:1783141793.548028:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141793.548034:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521033216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.548134:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521033216:12345-0@lo:400:kworker.0 Request processed in 99us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.548254:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141793.548292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141793.548299:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141793.548421:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521032704:0@lo:400:kworker.0 00000100:00100000:0.0:1783141793.548449:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521033728:12345-0@lo:400:kworker.0 Request processed in 152us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141793.548466:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783141793.548483:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141793.548486:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783141793.548578:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dc700 x1869759521033216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141793.548589:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521033216:0@lo:400:kworker.0 00010000:00080000:2.0:1783141793.548599:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43554700 x1869759521033728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141793.548608:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521033728:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.548731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.548806:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521033856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.548831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.549011:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521032832:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549023:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783141793.549029:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521032960:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.549083:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521033472:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.549128:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521033984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141793.549159:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141793.549199:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521032960 00000100:00100000:1.0:1783141793.549203:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521032960 00000100:00100000:1.0:1783141793.549229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033472 00000100:00100000:1.0:1783141793.549232:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033472 00000100:00100000:1.0:1783141793.549245:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141793.549251:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521032960:12345-0@lo:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141793.549324:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141793.549558:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141793.549566:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521033472:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141793.549601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141793.549629:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521032960:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.549637:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521033472:0@lo:400:kworker.0 00000100:00100000:3.0:1783141793.550132:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033344 00000100:00100000:3.0:1783141793.550297:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033344 00000100:00100000:3.0:1783141793.550333:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033856 00000100:00100000:3.0:1783141793.550336:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033856 00000100:00100000:3.0:1783141793.550352:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141793.550358:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521033344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141793.550403:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521033344:12345-0@lo:400:kworker.0 Request processed in 45us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.550410:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141793.550423:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141793.550429:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521033856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141793.550454:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521033856:12345-0@lo:400:kworker.0 Request processed in 26us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141793.550467:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783141793.550497:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dd500 x1869759521033344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141793.550509:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521033344:0@lo:400:kworker.0 00010000:00080000:3.0:1783141793.550520:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557800 x1869759521033856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141793.550527:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521033856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141793.553038:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521033984 00000100:00100000:1.0:1783141793.553052:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521033984 00000100:00100000:1.0:1783141793.553113:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141793.553122:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521033984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141793.553156:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141793.553435:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521033984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 314us (4275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141793.553444:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783141793.554723:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b4367a680 x1869759521033984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141793.554746:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521033984:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783141793.556024:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141793.556033:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783141793.671079:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141794.049844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141794.049882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141794.050038:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049088 00000100:00100000:1.0:1783141794.050047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049088 00000100:00100000:1.0:1783141794.050118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:1.0:1783141794.050129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501049088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141794.050196:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501049088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141794.050205:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00080000:2.0:1783141794.050415:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141794.052418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141794.052450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141794.052481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141794.052916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049216 00000100:00100000:2.0:1783141794.052925:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049216 00000100:00100000:2.0:1783141794.052985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:2.0:1783141794.052995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141794.053067:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141794.053074:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00080000:2.0:1783141794.053096:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141794.055141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501048960 00000100:00100000:3.0:1783141794.055156:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501048960 00000100:00100000:3.0:1783141794.055223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:3.0:1783141794.055233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501048960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141794.055332:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501048960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 100us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141794.055341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:3.0:1783141794.057084:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141794.057104:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521034240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141794.057162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141794.057254:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034240 00000100:00100000:3.0:1783141794.057261:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034240 00000100:00100000:3.0:1783141794.057311:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141794.057318:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521034240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141794.057349:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141794.057389:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521034240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141794.057396:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141794.057463:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521034240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141794.063140:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049344 00000100:00100000:0.0:1783141794.063235:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049344 00000100:00100000:3.0:1783141794.064040:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049472 00000100:00100000:3.0:1783141794.064048:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049472 00000100:00100000:3.0:1783141794.064076:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783141794.064087:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141794.064370:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 284us (14485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141794.064378:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783141794.064396:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:3.0:1783141794.064404:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141794.064430:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501049472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (11949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141794.064436:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00080000:0.0:1783141794.064641:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141794.064645:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141794.564973:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521034368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141794.565043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141794.565222:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034368 00000100:00100000:1.0:1783141794.565230:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034368 00000100:00100000:1.0:1783141794.565305:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141794.565314:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521034368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141794.565344:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141794.569948:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521034368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4625us (4895us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141794.569962:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783141794.570352:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bc000 x1869759521034368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141794.570398:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521034368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783141794.692659:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141795.076523:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141795.076547:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521034496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141795.076648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141795.082167:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034496 00000100:00100000:2.0:1783141795.082181:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034496 00000100:00100000:2.0:1783141795.082309:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783141795.082320:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521034496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141795.082347:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141795.082420:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521034496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141795.082427:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1783141795.082521:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bf480 x1869759521034496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141795.082543:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521034496:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783141795.085591:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783141795.717856:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141796.740562:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141797.064048:0:10697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1783141797.766562:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141798.154899:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521034624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141798.154962:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141798.155299:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034624 00000100:00100000:2.0:1783141798.155307:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034624 00000100:00100000:2.0:1783141798.155354:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783141798.155364:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521034624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141798.155396:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141798.156865:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521034624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1498us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141798.156876:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783141798.160385:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521034624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141798.660512:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521034752:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660587:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660636:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521035264:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660676:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521035776:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660698:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660725:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783141798.660733:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521035136:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660768:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660787:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521035648:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660811:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660829:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521036160:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660848:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660883:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521035008:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660930:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521035520:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660953:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.660970:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521036032:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.660994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.661012:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783141798.661018:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521034880:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661053:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.661075:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521035392:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661098:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.661113:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521035904:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141798.661162:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035264 00000100:00100000:1.0:1783141798.661169:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035264 00000100:00100000:1.0:1783141798.661213:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035776 00000100:00100000:1.0:1783141798.661217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035776 00000100:00100000:1.0:1783141798.661229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035136 00000100:00100000:1.0:1783141798.661231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035136 00000100:00100000:1.0:1783141798.661243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034880 00000100:00100000:1.0:1783141798.661244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034880 00000100:00100000:1.0:1783141798.661253:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035392 00000100:00100000:1.0:1783141798.661255:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035392 00000100:00100000:1.0:1783141798.661266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035904 00000100:00100000:1.0:1783141798.661289:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035904 00000100:00100000:1.0:1783141798.661308:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141798.661317:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521035264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521035264:12345-0@lo:400:kworker.0 Request processed in 57us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141798.661406:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141798.661412:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521035776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661466:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521035776:12345-0@lo:400:kworker.0 Request processed in 53us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661471:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141798.661484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783141798.661489:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521035136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521035136:12345-0@lo:400:kworker.0 Request processed in 25us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783141798.661529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783141798.661534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521034880:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661568:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783141798.661580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783141798.661587:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661615:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521035392:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661621:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783141798.661633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783141798.661640:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521035904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.661665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521035904:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.661676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783141798.661706:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035648 00000100:00100000:1.0:1783141798.661710:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035648 00000100:00100000:1.0:1783141798.661736:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036160 00000100:00100000:1.0:1783141798.661740:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036160 00000100:00100000:1.0:1783141798.661768:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035520 00000100:00100000:1.0:1783141798.661771:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035520 00000100:00100000:1.0:1783141798.661784:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036032 00000100:00100000:1.0:1783141798.661786:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036032 00000100:00100000:1.0:1783141798.661797:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141798.661803:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.662072:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141798.662083:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521036160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.662120:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521036160:12345-0@lo:400:kworker.0 Request processed in 40us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141798.662126:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141798.662140:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141798.662146:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.662171:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521035520:12345-0@lo:400:kworker.0 Request processed in 26us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141798.662177:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141798.662186:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141798.662192:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521036032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.662528:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521035648:12345-0@lo:400:kworker.0 Request processed in 724us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.662535:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141798.662556:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521035008 00000100:00100000:1.0:1783141798.662560:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521035008 00000100:00100000:1.0:1783141798.662592:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783141798.662601:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521035008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.662632:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521035008:12345-0@lo:400:kworker.0 Request processed in 33us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141798.662637:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783141798.662683:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521034880:0@lo:400:kworker.0 00010000:00080000:1.0:1783141798.662698:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f9180 x1869759521035392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141798.662708:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521035392:0@lo:400:kworker.0 00010000:00080000:1.0:1783141798.662719:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f8a80 x1869759521035904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141798.662736:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521035904:0@lo:400:kworker.0 00000100:00100000:3.0:1783141798.663651:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141798.663670:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521036288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141798.663718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141798.663779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521034752 00000100:00100000:3.0:1783141798.663784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521034752 00000100:00100000:3.0:1783141798.663821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783141798.663829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141798.663870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521034752:12345-0@lo:400:kworker.0 Request processed in 42us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141798.663876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783141798.663944:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036288 00000100:00100000:3.0:1783141798.663948:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036288 00000100:00100000:3.0:1783141798.663974:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783141798.663982:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521036288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141798.664013:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141798.664052:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521036288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141798.664058:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783141798.664079:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521036416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141798.664109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141798.664136:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036416 00000100:00100000:3.0:1783141798.664139:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036416 00000100:00100000:3.0:1783141798.664159:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141798.664166:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1869759521036416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783141798.664176:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141798.664207:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1869759521036416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141798.664213:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783141798.664244:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762adc00 x1869759521036288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141798.664261:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521036288:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783141798.664319:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43679880 x1869759521036416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141798.664330:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521036416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141798.665103:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521036032:12345-0@lo:400:kworker.0 Request processed in 2910us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141798.665112:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1783141798.665138:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141798.665142:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141798.665145:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141798.665148:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141798.667066:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521035136:0@lo:400:kworker.0 00010000:00080000:0.0:1783141798.667085:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f9c00 x1869759521035648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141798.667096:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521035648:0@lo:400:kworker.0 00010000:00080000:0.0:1783141798.667107:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fa680 x1869759521036160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141798.667116:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521036160:0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.667128:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521034752:0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.667139:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521035264:0@lo:400:kworker.0 00000100:00100000:0.0:1783141798.667149:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521035776:0@lo:400:kworker.0 00000100:00100000:1.0:1783141798.667855:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521035008:0@lo:400:kworker.0 00010000:00080000:1.0:1783141798.667881:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fa300 x1869759521035520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141798.667901:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521035520:0@lo:400:kworker.0 00010000:00080000:1.0:1783141798.667916:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f8700 x1869759521036032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141798.667923:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521036032:0@lo:400:kworker.0 00010000:00010000:0.0:1783141798.788501:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141799.173979:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521036544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141799.174043:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141799.174163:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036544 00000100:00100000:0.0:1783141799.174171:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036544 00000100:00100000:0.0:1783141799.174210:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141799.174218:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521036544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141799.174249:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141799.174314:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521036544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141799.174333:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783141799.174406:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521036544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141799.190457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141799.190504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141799.190537:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141799.190559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141799.190595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141799.190632:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050112 00000100:00100000:3.0:1783141799.190641:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050112 00000100:00100000:1.0:1783141799.190662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049600 00000100:00100000:1.0:1783141799.190668:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049600 00000100:00100000:1.0:1783141799.190710:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 276 00000100:00100000:3.0:1783141799.190711:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049984 00000100:00100000:1.0:1783141799.190722:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501049600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141799.190724:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049984 00000100:00100000:3.0:1783141799.190772:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:3.0:1783141799.190782:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501050112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141799.190804:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501049600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141799.190812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 276 00000100:00100000:3.0:1783141799.190822:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501050112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141799.190829:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:3.0:1783141799.190847:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783141799.190855:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501049984:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141799.190881:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501049984:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141799.190896:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783141799.190921:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049856 00000100:00100000:3.0:1783141799.190925:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049856 00000100:00100000:3.0:1783141799.190951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501049728 00000100:00100000:3.0:1783141799.190954:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501049728 00000100:00100000:3.0:1783141799.190980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:3.0:1783141799.190987:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501049856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141799.191014:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:1.0:1783141799.191025:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501049728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141799.191030:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501049856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141799.191039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:1.0:1783141799.191060:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501049728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00080000:3.0:1783141799.191062:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141799.191068:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141799.191072:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00080000:3.0:1783141799.191074:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141799.191077:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141799.687537:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141799.687560:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521036672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141799.687623:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141799.687772:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036672 00000100:00100000:2.0:1783141799.687780:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036672 00000100:00100000:2.0:1783141799.687829:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783141799.687839:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521036672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141799.687866:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141799.687906:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521036672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141799.687913:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1783141799.687989:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bc380 x1869759521036672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141799.688005:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521036672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141799.812687:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141800.199981:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141800.200003:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521036800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141800.200098:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141800.200304:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036800 00000100:00100000:2.0:1783141800.200312:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036800 00000100:00100000:2.0:1783141800.200370:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141800.200381:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521036800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141800.200404:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141800.200447:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521036800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141800.200460:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1783141800.200499:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bea00 x1869759521036800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141800.200515:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521036800:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783141800.203762:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783141800.847881:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141801.860897:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783141802.297990:0:10941:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing yml_node 00010000:00010000:2.0:1783141802.884566:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141803.280836:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141803.280859:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521036928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141803.280926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141803.281151:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521036928 00000100:00100000:3.0:1783141803.281159:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521036928 00000100:00100000:3.0:1783141803.281255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783141803.281266:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521036928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141803.281337:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141803.281385:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521036928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141803.281392:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141803.287790:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521036928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141803.780574:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141803.780595:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521037184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141803.780661:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141803.780744:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037184 00000100:00100000:0.0:1783141803.780752:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037184 00000100:00100000:0.0:1783141803.780802:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141803.780812:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521037184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141803.780839:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141803.780877:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521037184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141803.780884:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1783141803.780902:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783141803.780927:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ae680 x1869759521037184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141803.780957:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521037184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141803.781095:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521037056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141803.781208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141803.781286:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037056 00000100:00100000:3.0:1783141803.781291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037056 00000100:00100000:3.0:1783141803.781329:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783141803.781336:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521037056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783141803.781347:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141803.781383:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521037056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141803.781390:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1783141803.781416:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fdc00 x1869759521037056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141803.781427:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521037056:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783141803.781480:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141803.782562:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141803.782660:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521037568:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.782700:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141803.782734:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141803.782744:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521037440:0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.782766:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521037696:0@lo:400:kworker.0 00000100:00100000:1.0:1783141803.782787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037568 00000100:00100000:1.0:1783141803.782793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037568 00000100:00100000:3.0:1783141803.782796:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141803.782838:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521037312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.782867:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141803.782900:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037696 00000100:00100000:3.0:1783141803.782904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037696 00000100:00100000:3.0:1783141803.782936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141803.782956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521037696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.783011:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521037696:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141803.783018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141803.783039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037312 00000100:00100000:3.0:1783141803.783042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037312 00000100:00100000:3.0:1783141803.783066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1783141803.783072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521037312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.783100:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521037312:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141803.783106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1783141803.783213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783141803.783220:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521037568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141803.783256:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521037568:12345-0@lo:400:kworker.0 Request processed in 37us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141803.783262:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783141803.783268:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521037696:0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.783298:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521037312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.785568:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521037824:0@lo:400:kworker.0 00000100:00100000:3.0:1783141803.786405:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141803.786473:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037824 00000100:00100000:1.0:1783141803.786480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037824 00000100:00100000:1.0:1783141803.786537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141803.786546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521037824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.786652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141803.786688:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521037568:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.786724:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521038080:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.786754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141803.786775:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141803.786783:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521037952:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.786833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141803.786863:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038080 00000100:00100000:2.0:1783141803.788032:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038080 00000100:00100000:2.0:1783141803.788092:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141803.788100:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521038080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.788172:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521038080:12345-0@lo:400:kworker.0 Request processed in 72us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141803.788180:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141803.788218:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037440 00000100:00100000:2.0:1783141803.788223:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037440 00000100:00100000:2.0:1783141803.788245:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521037952 00000100:00100000:2.0:1783141803.788248:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521037952 00000100:00100000:2.0:1783141803.788267:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783141803.788819:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521037440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.788866:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521037440:12345-0@lo:400:kworker.0 Request processed in 592us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141803.788876:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783141803.788897:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141803.788907:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.788946:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521037952:12345-0@lo:400:kworker.0 Request processed in 43us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141803.789235:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1783141803.789312:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f9f80 x1869759521037952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141803.789674:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521037952:0@lo:400:kworker.0 00010000:00080000:2.0:1783141803.790058:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f8a80 x1869759521038080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141803.790977:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521038080:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.790997:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521037440:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.791330:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521038208:0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.791455:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141803.791571:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038208 00000100:00100000:2.0:1783141803.791578:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038208 00000100:00100000:2.0:1783141803.791624:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783141803.791631:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521038208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.791674:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cb0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521038208:12345-0@lo:400:kworker.0 Request processed in 43us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141803.791680:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783141803.792049:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f9180 x1869759521038208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141803.792056:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521038208:0@lo:400:kworker.0 00000100:00080000:2.0:1783141803.792146:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141803.792151:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141803.792154:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141803.792973:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521038464:0@lo:400:kworker.0 00000100:00100000:0.0:1783141803.793015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141803.793073:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038464 00000100:00100000:0.0:1783141803.793078:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038464 00000100:00100000:2.0:1783141803.793083:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141803.793095:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521038336:0@lo:400:kworker.0 00000100:00100000:0.0:1783141803.793138:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783141803.793147:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.793192:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141803.793205:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521038464:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141803.793212:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783141803.793226:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038336 00000100:00100000:2.0:1783141803.793231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038336 00000100:00100000:2.0:1783141803.793257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783141803.793264:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141803.793317:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521038336:12345-0@lo:400:kworker.0 Request processed in 55us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141803.793323:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1783141803.793339:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141803.793342:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783141803.793364:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7f8e00 x1869759521038464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141803.793366:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521038336:0@lo:400:kworker.0 00000100:00100000:0.0:1783141803.793383:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521038464:0@lo:400:kworker.0 00000100:00100000:1.0:1783141803.793944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521037824:12345-0@lo:400:kworker.0 Request processed in 7397us (7538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141803.793946:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521037824:0@lo:400:kworker.0 00000100:00100000:1.0:1783141803.793959:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1783141803.910379:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141804.292974:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521038592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141804.293057:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141804.293294:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038592 00000100:00100000:3.0:1783141804.293304:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038592 00000100:00100000:3.0:1783141804.293357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141804.293366:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521038592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141804.293410:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141804.293463:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521038592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141804.293470:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141804.293514:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521038592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141804.303656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141804.304043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050240 00000100:00100000:0.0:1783141804.304054:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050240 00000100:00100000:0.0:1783141804.304137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:0.0:1783141804.304146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501050240:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141804.304231:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2402:x1869759501050240:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141804.304239:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:3.0:1783141804.306884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141804.307008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141804.309668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050368 00000100:00100000:2.0:1783141804.309681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050368 00000100:00100000:2.0:1783141804.309764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050496 00000100:00100000:2.0:1783141804.309768:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050496 00000100:00100000:2.0:1783141804.309794:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:2.0:1783141804.309804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501050368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141804.309877:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501050368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141804.309885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:2.0:1783141804.309902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1783141804.309908:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501050496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141804.309933:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501050496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141804.309939:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00080000:3.0:1783141804.310141:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141804.310145:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141804.334120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141804.334297:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050624 00000100:00100000:3.0:1783141804.334307:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050624 00000100:00100000:3.0:1783141804.334369:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141804.334378:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2399:x1869759501050624:12345-192.168.203.39@tcp:9:kworker.0 00000100:00080000:1.0:1783141804.335628:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1783141804.338337:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806dbe 00000100:00080000:3.0:1783141804.338358:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141804.338409:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783141804.338449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141804.338587:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+2:2399:x1869759501050624:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 4206us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141804.338597:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141804.338617:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050752 00000100:00100000:3.0:1783141804.338623:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050752 00000100:00100000:3.0:1783141804.338667:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783141804.338676:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2399:x1869759501050752:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1783141804.338695:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806db7 00000100:00080000:0.0:1783141804.338697:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141804.338703:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141804.338761:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1783141804.338777:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141804.338839:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+2:2399:x1869759501050752:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 164us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141804.338847:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00010000:00010000:0.0:1783141804.339008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141804.808259:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521038720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141804.808354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141804.808418:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038720 00000100:00100000:0.0:1783141804.808427:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038720 00000100:00100000:0.0:1783141804.808483:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141804.808492:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521038720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141804.808520:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141804.808587:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521038720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141804.808594:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1783141804.808702:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bdf80 x1869759521038720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141804.808727:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521038720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141804.932635:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141805.316686:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141805.316742:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521038848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141805.316814:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141805.316873:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038848 00000100:00100000:0.0:1783141805.316881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038848 00000100:00100000:0.0:1783141805.316938:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783141805.316945:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783141805.316949:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521038848:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141805.316953:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1783141805.316972:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141805.317036:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521038848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141805.317042:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783141805.317257:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bce00 x1869759521038848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141805.317306:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521038848:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783141805.317798:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783141805.956501:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141806.985898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141807.942734:0:11126:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.86 00010000:00010000:3.0:1783141808.013011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141808.388606:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141808.388627:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521038976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141808.388706:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141808.388875:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521038976 00000100:00100000:1.0:1783141808.388882:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521038976 00000100:00100000:1.0:1783141808.388935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141808.388947:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521038976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141808.388977:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783141808.389157:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521038976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141808.389443:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521038976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 498us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141808.389451:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783141808.900505:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521039104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141808.900587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141808.900660:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039104 00000100:00100000:0.0:1783141808.900667:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039104 00000100:00100000:0.0:1783141808.900722:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783141808.900730:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521039104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141808.900756:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141808.900792:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521039104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141808.900798:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1783141808.900853:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fb800 x1869759521039104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141808.900869:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521039104:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783141808.901182:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141808.902224:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521039232:0@lo:400:kworker.0 00000100:00100000:1.0:1783141808.902300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141808.902599:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141808.902635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141808.902686:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039488 00000100:00100000:0.0:1783141808.902694:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039488 00000100:00100000:0.0:1783141808.902741:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783141808.902748:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521039488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783141808.902768:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141808.902806:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521039488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141808.902813:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1783141808.902847:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fb800 x1869759521039488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141808.902862:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141808.904428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039232 00000100:00100000:0.0:1783141808.904440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039232 00000100:00100000:0.0:1783141808.904493:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1783141808.904500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521039232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905496:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521039360:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141808.905590:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521039872:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905609:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141808.905623:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521040384:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141808.905657:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141808.905662:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521039744:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905691:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141808.905707:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521040256:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141808.905778:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039360 00000100:00100000:3.0:1783141808.905785:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039360 00000100:00100000:3.0:1783141808.905817:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039872 00000100:00100000:3.0:1783141808.905820:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039872 00000100:00100000:3.0:1783141808.905836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040384 00000100:00100000:3.0:1783141808.905838:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040384 00000100:00100000:3.0:1783141808.905852:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039744 00000100:00100000:3.0:1783141808.905854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039744 00000100:00100000:3.0:1783141808.905868:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783141808.905876:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905921:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521039360:12345-0@lo:400:kworker.0 Request processed in 45us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141808.905928:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783141808.905944:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783141808.905950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.905976:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521039872:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141808.905982:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783141808.905993:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783141808.905998:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521040384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.906024:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521040384:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.907433:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783141808.907449:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907525:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521039744:12345-0@lo:400:kworker.0 Request processed in 80us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.907532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783141808.907572:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521040000:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141808.907628:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521040512:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141808.907666:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783141808.907672:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521039616:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907708:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141808.907728:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521040128:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141808.907773:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521039616 00000100:00100000:2.0:1783141808.907780:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521039616 00000100:00100000:2.0:1783141808.907813:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783141808.907819:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521039616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907857:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521039616:12345-0@lo:400:kworker.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.907863:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783141808.907881:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040256 00000100:00100000:2.0:1783141808.907892:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040256 00000100:00100000:2.0:1783141808.907919:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040128 00000100:00100000:2.0:1783141808.907922:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040128 00000100:00100000:2.0:1783141808.907941:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141808.907945:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521040256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.907975:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521040256:12345-0@lo:400:kworker.0 Request processed in 29us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.907981:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141808.907993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783141808.907998:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908023:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521040128:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.908028:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783141808.908052:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040000 00000100:00100000:2.0:1783141808.908055:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040000 00000100:00100000:2.0:1783141808.908070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040512 00000100:00100000:2.0:1783141808.908073:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040512 00000100:00100000:2.0:1783141808.908084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783141808.908089:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521040000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908118:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521040000:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.908123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783141808.908134:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141808.908139:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908164:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521040512:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141808.908170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141808.908218:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521039616:0@lo:400:kworker.0 00010000:00080000:2.0:1783141808.908229:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fdf80 x1869759521040128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141808.908238:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521040128:0@lo:400:kworker.0 00010000:00080000:2.0:1783141808.908246:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fd880 x1869759521040000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141808.908253:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521040000:0@lo:400:kworker.0 00010000:00080000:2.0:1783141808.908261:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437ff480 x1869759521040512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141808.908269:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521040512:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908361:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521039744:0@lo:400:kworker.0 00010000:00080000:2.0:1783141808.908373:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437ff800 x1869759521040256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141808.908382:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521040256:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908394:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521039360:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908405:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521039872:0@lo:400:kworker.0 00000100:00100000:2.0:1783141808.908416:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521040384:0@lo:400:kworker.0 00000100:00100000:3.0:1783141808.909231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1783141808.909312:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141808.909317:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141808.909319:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141808.909322:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141808.910782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521039232:12345-0@lo:400:kworker.0 Request processed in 6275us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141808.910794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1783141808.911292:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521039232:0@lo:400:kworker.0 00010000:00010000:1.0:1783141809.031424:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141809.412799:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141809.412820:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521040640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141809.412890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141809.412979:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040640 00000100:00100000:1.0:1783141809.412992:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040640 00000100:00100000:1.0:1783141809.413039:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783141809.413040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141809.413050:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521040640:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141809.413077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00000024:1.0:1783141809.413084:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783141809.413153:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521040640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.413157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141809.413166:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783141809.413184:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051008 00000100:00100000:1.0:1783141809.413195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501050880 00000100:00100000:1.0:1783141809.413200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501050880 00000100:00100000:2.0:1783141809.413202:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051008 00000100:00100000:1.0:1783141809.413229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 280 00000100:00100000:1.0:1783141809.413238:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501050880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141809.413258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051136 00000100:00100000:2.0:1783141809.413262:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051136 00000100:00100000:1.0:1783141809.413305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501050880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.413307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:2.0:1783141809.413319:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501051008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141809.413319:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 280 00000100:00100000:2.0:1783141809.413356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501051008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.413363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:2.0:1783141809.413381:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:2.0:1783141809.413389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501051136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141809.413424:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501051136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.413432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:1.0:1783141809.413453:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521040640:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1783141809.413684:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141809.413689:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141809.925108:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141809.925131:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521040768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141809.925203:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141809.931118:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040768 00000100:00100000:2.0:1783141809.931131:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040768 00000100:00100000:2.0:1783141809.931187:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141809.931198:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521040768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141809.931231:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141809.931307:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521040768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.931314:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1783141809.931595:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bf480 x1869759521040768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141809.931628:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521040768:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1783141809.933934:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:3.0:1783141809.933944:0:9517:0:(genops.c:906:class_export_put()) final put ffff9f9b432c4800/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:0.0:1783141809.934000:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b432c4800/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-OST0001 00000020:00000080:0.0:1783141809.934050:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b432c6800 for lustre-OST0001 00000001:00100000:2.0:1783141809.934679:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:2.0:1783141809.934684:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9b432c3000/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:2.0:1783141809.935384:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b432c3000/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-OST0000 00000020:00000080:2.0:1783141809.935424:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b432c2800 for lustre-OST0000 00010000:00010000:2.0:1783141810.064426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141810.361959:0:11223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.86 00000100:00100000:0.0:1783141810.436502:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521040896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141810.436579:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141810.436754:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521040896 00000100:00100000:2.0:1783141810.436762:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521040896 00000100:00100000:2.0:1783141810.436828:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141810.436837:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521040896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141810.436859:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141810.436900:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521040896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141810.436906:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1783141810.436959:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141810.436990:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bd500 x1869759521040896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141810.437006:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521040896:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783141811.084643:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141812.100485:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141813.068442:0:11321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.86 00010000:00010000:3.0:1783141813.127362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141813.508554:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141813.508581:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521041024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141813.508656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141813.508777:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041024 00000100:00100000:2.0:1783141813.508786:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041024 00000100:00100000:2.0:1783141813.508845:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783141813.508855:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521041024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141813.508890:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141813.509006:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521041024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141813.509015:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783141813.509089:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521041024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141814.020793:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521041152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141814.020862:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.020944:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521041280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141814.021014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.021069:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041152 00000100:00100000:1.0:1783141814.021077:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041152 00000100:00100000:1.0:1783141814.021132:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041280 00000100:00100000:1.0:1783141814.021154:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041280 00000100:00100000:1.0:1783141814.021178:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783141814.021187:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521041152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141814.021214:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141814.021240:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783141814.021253:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521041280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141814.021261:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521041152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (399us total) trans 0 rc 0/0 00002000:00000024:3.0:1783141814.021267:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141814.021293:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783141814.021337:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521041280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141814.021346:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141814.021408:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521041536:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.021480:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521042048:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021503:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.021521:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521042560:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.021575:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783141814.021582:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521041664:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141814.021651:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521042176:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141814.021711:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041536 00000100:00100000:3.0:1783141814.021717:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041536 00000100:00100000:1.0:1783141814.021726:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521042688:0@lo:400:kworker.0 00000100:00100000:3.0:1783141814.021742:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042048 00000100:00100000:3.0:1783141814.021746:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042048 00000100:00100000:1.0:1783141814.021762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141814.021764:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042560 00000100:00100000:3.0:1783141814.021768:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042560 00000100:00100000:3.0:1783141814.021785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042176 00000100:00100000:3.0:1783141814.021788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042176 00000100:00100000:1.0:1783141814.021789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042688 00000100:00100000:1.0:1783141814.021794:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042688 00000100:00100000:3.0:1783141814.021807:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783141814.021816:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.021824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783141814.021834:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521042048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141814.021863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521041536:12345-0@lo:400:kworker.0 Request processed in 48us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141814.021872:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783141814.021878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521042048:12345-0@lo:400:kworker.0 Request processed in 44us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141814.021890:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783141814.021898:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521042560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141814.021932:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521042560:12345-0@lo:400:kworker.0 Request processed in 35us (392us total) trans 0 rc 0/0 00000100:00080000:0.0:1783141814.021948:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141814.021952:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141814.021955:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141814.021969:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521041408:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022001:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.022025:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521041920:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022046:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.022072:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521042432:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022094:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.022113:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783141814.022119:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521041792:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022140:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.022151:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521042304:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.022191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041408 00000100:00100000:0.0:1783141814.022194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041408 00000100:00100000:0.0:1783141814.022220:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1783141814.022226:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521041408:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.022263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1783141814.022316:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041664 00000100:00100000:0.0:1783141814.022320:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041664 00000100:00100000:0.0:1783141814.022338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041920 00000100:00100000:0.0:1783141814.022340:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041920 00000100:00100000:0.0:1783141814.022351:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783141814.022356:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022384:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521041664:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.022390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783141814.022401:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783141814.022406:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521041920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022430:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521041920:12345-0@lo:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.022444:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783141814.022461:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042432 00000100:00100000:0.0:1783141814.022464:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042432 00000100:00100000:0.0:1783141814.022488:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042304 00000100:00100000:0.0:1783141814.022490:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042304 00000100:00100000:0.0:1783141814.022507:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141814.022512:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521042432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022556:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521042432:12345-0@lo:400:kworker.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.022563:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141814.022575:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141814.022580:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022625:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521042304:12345-0@lo:400:kworker.0 Request processed in 45us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.022630:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1783141814.022670:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141814.022705:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fe680 x1869759521041280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141814.022730:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521041280:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783141814.022768:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fdf80 x1869759521042304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141814.022777:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521042304:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022792:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521041408:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.022801:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521041920:0@lo:400:kworker.0 00010000:00080000:0.0:1783141814.022818:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7ff800 x1869759521042432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141814.022834:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521042432:0@lo:400:kworker.0 00010000:00080000:0.0:1783141814.022874:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ae680 x1869759521041152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141814.022885:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521041152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141814.022946:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783141814.022954:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783141814.022987:0:7934:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783141814.022998:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521041792 00000100:00100000:0.0:1783141814.023001:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521041792 00000100:00100000:1.0:1783141814.023333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783141814.023353:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783141814.023362:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521042176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.023404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521042176:12345-0@lo:400:kworker.0 Request processed in 43us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141814.023411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783141814.023419:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783141814.023427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783141814.023436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521042688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.023466:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521042688:12345-0@lo:400:kworker.0 Request processed in 32us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141814.023473:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783141814.023522:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521041664:0@lo:400:kworker.0 00010000:00080000:1.0:1783141814.023534:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fd880 x1869759521042176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141814.023544:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521042176:0@lo:400:kworker.0 00010000:00080000:1.0:1783141814.023554:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fca80 x1869759521042688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141814.023562:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521042688:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.023572:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521041536:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.023582:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521042048:0@lo:400:kworker.0 00000100:00100000:1.0:1783141814.023592:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521042560:0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.026016:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783141814.026035:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521041792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141814.026141:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521041792:12345-0@lo:400:kworker.0 Request processed in 114us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.026148:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783141814.027705:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521041792:0@lo:400:kworker.0 00010000:00010000:2.0:1783141814.148516:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141814.529211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141814.529258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141814.529310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141814.529336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051264 00000100:00100000:1.0:1783141814.529344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051264 00000100:00100000:1.0:1783141814.529389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 282 00000100:00100000:1.0:1783141814.529398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501051264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141814.529461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501051264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141814.529469:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 282 00000100:00100000:1.0:1783141814.529498:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051392 00000100:00100000:1.0:1783141814.529502:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051392 00000100:00100000:1.0:1783141814.529534:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051520 00000100:00100000:1.0:1783141814.529537:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051520 00000100:00100000:1.0:1783141814.529559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:1.0:1783141814.529579:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501051392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141814.529612:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501051392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141814.529619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:1.0:1783141814.529631:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:1.0:1783141814.529649:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501051520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141814.529673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501051520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141814.529680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00080000:1.0:1783141814.529798:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141814.529810:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141814.536876:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141814.536911:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521042816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141814.536976:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141814.537202:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042816 00000100:00100000:0.0:1783141814.537210:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042816 00000100:00100000:0.0:1783141814.537255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141814.537263:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521042816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141814.537318:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141814.537362:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521042816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141814.537384:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141814.537429:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521042816:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1783141814.593716:0:11370:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jul 4 01:10:13 EDT 2026 00000100:00100000:3.0:1783141815.044922:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141815.044956:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521042944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141815.045023:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141815.045196:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521042944 00000100:00100000:2.0:1783141815.045204:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521042944 00000100:00100000:2.0:1783141815.045256:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141815.045266:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521042944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141815.045319:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141815.045366:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521042944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141815.045389:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783141815.045474:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bd500 x1869759521042944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141815.045491:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521042944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141815.172497:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141815.556615:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521043072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141815.556697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141815.556809:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043072 00000100:00100000:0.0:1783141815.556816:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043072 00000100:00100000:0.0:1783141815.556867:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141815.556877:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521043072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141815.556900:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141815.556944:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521043072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141815.556951:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1783141815.557028:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fce00 x1869759521043072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141815.557046:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521043072:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783141816.201136:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141817.226696:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141818.246088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141818.628578:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521043200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141818.628661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141818.628858:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043200 00000100:00100000:2.0:1783141818.628865:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043200 00000100:00100000:2.0:1783141818.628912:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783141818.628920:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521043200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141818.628950:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141818.629002:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521043200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141818.629008:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783141818.629211:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521043200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141819.140648:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521043328:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.140656:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521043712:0@lo:400:kworker.0 00000100:00100000:0.0:1783141819.140765:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521043456:0@lo:400:kworker.0 00000100:00100000:2.0:1783141819.140847:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521043584:0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.144136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141819.144547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141819.144618:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521043968:0@lo:400:kworker.0 00000100:00100000:0.0:1783141819.144648:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141819.144673:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521044480:0@lo:400:kworker.0 00000100:00100000:0.0:1783141819.144692:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.144883:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.144907:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521044224:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.144931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.144945:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521044736:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.144962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.145009:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043456 00000100:00100000:1.0:1783141819.145015:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043456 00000100:00100000:1.0:1783141819.145121:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043968 00000100:00100000:1.0:1783141819.145125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043968 00000100:00100000:1.0:1783141819.145216:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044480 00000100:00100000:1.0:1783141819.145220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044480 00000100:00100000:1.0:1783141819.145480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043712 00000100:00100000:1.0:1783141819.145484:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043712 00000100:00100000:1.0:1783141819.145500:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783141819.145508:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521043456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.145536:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521043840:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.145560:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521043456:12345-0@lo:400:kworker.0 Request processed in 51us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.145568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783141819.145578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.145587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783141819.145594:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.145616:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521044352:0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.145657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.145663:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521043968:12345-0@lo:400:kworker.0 Request processed in 67us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.145670:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783141819.145685:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521044864:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.145687:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141819.145697:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.145714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.145738:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521044480:12345-0@lo:400:kworker.0 Request processed in 41us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.145863:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043328 00000100:00100000:0.0:1783141819.145867:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043328 00000100:00100000:0.0:1783141819.145899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783141819.145906:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141819.145991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141819.146013:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521044096:0@lo:400:kworker.0 00000100:00100000:2.0:1783141819.146036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141819.146046:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521044608:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.146125:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141819.146137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044096 00000100:00100000:1.0:1783141819.146140:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044096 00000100:00100000:1.0:1783141819.146220:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783141819.146236:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521043712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.146268:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521043712:12345-0@lo:400:kworker.0 Request processed in 42us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.146460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783141819.146474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783141819.146481:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.146513:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521044096:12345-0@lo:400:kworker.0 Request processed in 33us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.146519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783141819.146545:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044224 00000100:00100000:1.0:1783141819.146548:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044224 00000100:00100000:1.0:1783141819.146566:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044736 00000100:00100000:1.0:1783141819.146569:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044736 00000100:00100000:1.0:1783141819.146580:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044352 00000100:00100000:1.0:1783141819.146582:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044352 00000100:00100000:1.0:1783141819.146592:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044864 00000100:00100000:1.0:1783141819.146861:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044864 00000100:00100000:1.0:1783141819.146885:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783141819.146890:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.146924:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521044224:12345-0@lo:400:kworker.0 Request processed in 33us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.146929:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783141819.146940:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783141819.146945:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521044736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.146969:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521044736:12345-0@lo:400:kworker.0 Request processed in 25us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.146975:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783141819.146985:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783141819.146990:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521044352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141819.147076:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141819.147105:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141819.147129:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783141819.147434:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b9180 x1869759521044096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141819.147449:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521044096:0@lo:400:kworker.0 00000100:00100000:2.0:1783141819.147483:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043840 00000100:00100000:2.0:1783141819.147487:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043840 00000100:00100000:2.0:1783141819.147512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521043584 00000100:00100000:2.0:1783141819.147515:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521043584 00000100:00100000:2.0:1783141819.147527:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783141819.147542:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521043840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.148489:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521043328:0@lo:400:kworker.0 00000100:00100000:0.0:1783141819.148527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521043328:12345-0@lo:400:kworker.0 Request processed in 2619us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.148546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783141819.148601:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044608 00000100:00100000:0.0:1783141819.148616:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044608 00000100:00100000:0.0:1783141819.148655:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141819.148662:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521044608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141819.148710:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521044608:12345-0@lo:400:kworker.0 Request processed in 48us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.148716:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141819.148739:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783141819.148747:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521043584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.148901:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521044352:12345-0@lo:400:kworker.0 Request processed in 1909us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.148909:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783141819.148926:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141819.148933:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.148964:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521044864:12345-0@lo:400:kworker.0 Request processed in 32us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.148970:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1783141819.148995:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141819.148999:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141819.149002:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141819.149004:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141819.149037:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521043712:0@lo:400:kworker.0 00010000:00080000:1.0:1783141819.149134:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433ba300 x1869759521044224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141819.149144:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521044224:0@lo:400:kworker.0 00010000:00080000:1.0:1783141819.149155:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b8700 x1869759521044736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141819.149163:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521044736:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.149217:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521044992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141819.149839:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141819.149880:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521043456:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.149892:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521043968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.149904:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521044480:0@lo:400:kworker.0 00000100:00100000:1.0:1783141819.149945:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045120 00000100:00100000:1.0:1783141819.149949:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045120 00000100:00100000:1.0:1783141819.149975:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521044992 00000100:00100000:1.0:1783141819.149978:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521044992 00000100:00100000:1.0:1783141819.149991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783141819.149997:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521045120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141819.150019:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141819.150157:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521043584:12345-0@lo:400:kworker.0 Request processed in 1411us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.150166:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783141819.150972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141819.150981:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521044992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783141819.150998:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141819.151034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521044992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.151040:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141819.151125:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521045120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.151133:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1783141819.151166:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fc380 x1869759521044992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141819.151198:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521044992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141819.151422:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521043840:12345-0@lo:400:kworker.0 Request processed in 3879us (5845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141819.151429:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1783141819.151469:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43575500 x1869759521045120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141819.151482:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141819.151493:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521043584:0@lo:400:kworker.0 00010000:00080000:2.0:1783141819.151503:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b8a80 x1869759521044608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141819.151511:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521044608:0@lo:400:kworker.0 00000100:00100000:3.0:1783141819.155376:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521043840:0@lo:400:kworker.0 00010000:00080000:3.0:1783141819.155400:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b9c00 x1869759521044352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141819.155410:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521044352:0@lo:400:kworker.0 00010000:00080000:3.0:1783141819.155422:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433ba680 x1869759521044864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141819.155445:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521044864:0@lo:400:kworker.0 00010000:00010000:3.0:1783141819.269782:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141819.649692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141819.649738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141819.649899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141819.650046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051648 00000100:00100000:0.0:1783141819.650056:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051648 00000100:00100000:0.0:1783141819.650118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 284 00000100:00100000:0.0:1783141819.650128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501051648:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141819.650226:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051904 00000100:00100000:1.0:1783141819.650230:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051904 00000100:00100000:2.0:1783141819.650244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501051776 00000100:00100000:2.0:1783141819.650247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501051776 00000100:00100000:1.0:1783141819.650288:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:2.0:1783141819.650296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:1.0:1783141819.650296:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501051904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141819.650302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501051776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141819.659201:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501051648:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 9062us (9506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.659238:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 284 00000100:00100000:1.0:1783141819.659326:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501051904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 9028us (9584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141819.659336:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00080000:1.0:1783141819.659371:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141819.659376:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141819.659478:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521045248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141819.659614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141819.660109:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045248 00000100:00100000:0.0:1783141819.660118:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045248 00000100:00100000:0.0:1783141819.660159:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783141819.660168:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521045248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141819.660201:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141819.660244:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521045248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141819.660251:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783141819.661982:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501051776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 11668us (12134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141819.661996:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:1.0:1783141819.664719:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521045248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141820.164639:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141820.164663:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521045376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141820.164725:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141820.165065:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045376 00000100:00100000:2.0:1783141820.165072:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045376 00000100:00100000:2.0:1783141820.165133:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783141820.165141:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521045376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141820.165167:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141820.165211:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521045376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141820.165224:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1783141820.165259:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437ffb80 x1869759521045376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141820.165296:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521045376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783141820.293477:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141820.676752:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521045504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141820.676824:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141820.676898:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045504 00000100:00100000:0.0:1783141820.676906:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045504 00000100:00100000:0.0:1783141820.676965:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783141820.676975:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521045504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141820.676999:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141820.677046:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521045504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141820.677054:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1783141820.677180:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7ff800 x1869759521045504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141820.677197:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521045504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141821.323406:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141822.344629:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141823.368873:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141823.757926:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141823.757956:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521045632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141823.758020:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141823.758137:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045632 00000100:00100000:2.0:1783141823.758144:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045632 00000100:00100000:2.0:1783141823.758193:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783141823.758202:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521045632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141823.758233:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141823.758306:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521045632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141823.758314:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783141823.758446:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521045632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141824.260513:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521045760:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.260590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.260646:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521046272:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.260663:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521045888:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.260678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.260700:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521046784:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.260709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.260733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.260736:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521046144:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.260740:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521046400:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.260758:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521047296:0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.260786:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.260794:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.260798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045888 00000100:00100000:2.0:1783141824.260807:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045888 00000100:00100000:0.0:1783141824.260823:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521046656:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.260845:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521046016:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.260854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046144 00000100:00100000:0.0:1783141824.260855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.260860:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046144 00000100:00100000:2.0:1783141824.260888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783141824.260893:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521047168:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.260901:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521045888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.260920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.260956:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046272 00000100:00100000:2.0:1783141824.260962:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521045888:12345-0@lo:400:kworker.0 Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.260968:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046272 00000100:00100000:2.0:1783141824.260993:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783141824.261002:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783141824.261011:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.261017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783141824.261027:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521046144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.261059:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521046272:12345-0@lo:400:kworker.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.261067:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783141824.261082:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521046144:12345-0@lo:400:kworker.0 Request processed in 55us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.261089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783141824.261095:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046784 00000100:00100000:0.0:1783141824.261100:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046784 00000100:00100000:0.0:1783141824.261131:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047296 00000100:00100000:0.0:1783141824.261134:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047296 00000100:00100000:2.0:1783141824.261146:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521046144:0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.261147:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046656 00000100:00100000:0.0:1783141824.261151:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046656 00000100:00100000:0.0:1783141824.261179:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047168 00000100:00100000:0.0:1783141824.261182:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047168 00000100:00100000:2.0:1783141824.261195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.261201:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141824.261209:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521046784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.261222:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521046912:0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.261250:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521046784:12345-0@lo:400:kworker.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.261258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.261262:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141824.261302:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141824.261306:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521047424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141824.261312:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521047296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.261335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.261357:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521047296:12345-0@lo:400:kworker.0 Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.261364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141824.261377:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521045888:0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.261379:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783141824.261391:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521046656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.261407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046400 00000100:00100000:2.0:1783141824.261412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046400 00000100:00100000:2.0:1783141824.261441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046912 00000100:00100000:2.0:1783141824.261444:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046912 00000100:00100000:2.0:1783141824.261460:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783141824.261465:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521046400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.262575:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521046656:12345-0@lo:400:kworker.0 Request processed in 1174us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.262601:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141824.262622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521046400:12345-0@lo:400:kworker.0 Request processed in 1154us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.262627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141824.262637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783141824.262641:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521047168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.262659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783141824.262668:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521046912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141824.262682:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521047168:12345-0@lo:400:kworker.0 Request processed in 43us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.262690:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783141824.262718:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141824.262720:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521046912:12345-0@lo:400:kworker.0 Request processed in 54us (1463us total) trans 0 rc 0/0 00000100:00080000:0.0:1783141824.262724:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141824.262729:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141824.262732:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783141824.262761:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047424 00000100:00100000:0.0:1783141824.262764:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521046272:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.262766:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047424 00010000:00080000:0.0:1783141824.262785:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43575500 x1869759521046784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141824.262796:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521046784:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.262804:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1783141824.262812:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a5c00 x1869759521047296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.262816:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521047424:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141824.262832:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521047296:0@lo:400:kworker.0 00002000:00000024:2.0:1783141824.262844:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141824.262879:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521047424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.262885:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1783141824.262925:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43574e00 x1869759521046656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.262935:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521046656:0@lo:400:kworker.0 00010000:00080000:2.0:1783141824.262945:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a6300 x1869759521047168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.262952:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521047168:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.263564:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521046400:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.263590:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.263594:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521046912:0@lo:400:kworker.0 00010000:00080000:2.0:1783141824.263608:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437ff800 x1869759521047424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.263625:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521047424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141824.263630:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521046528:0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.263664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.263689:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521047040:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.263692:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046528 00000100:00100000:2.0:1783141824.263705:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046528 00000100:00100000:1.0:1783141824.263711:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.263729:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521047552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141824.263745:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047040 00000100:00100000:2.0:1783141824.263749:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047040 00000100:00100000:1.0:1783141824.263754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.263776:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783141824.263785:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521046528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.263789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521045760 00000100:00100000:1.0:1783141824.263795:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521045760 00000100:00100000:1.0:1783141824.263826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783141824.263834:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521045760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.263837:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521046528:12345-0@lo:400:kworker.0 Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.263846:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783141824.263864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783141824.263873:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.263879:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521045760:12345-0@lo:400:kworker.0 Request processed in 45us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.263894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1783141824.263913:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521047040:12345-0@lo:400:kworker.0 Request processed in 40us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.263920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783141824.263936:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521046016 00000100:00080000:2.0:1783141824.263941:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141824.263941:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521046016 00000100:00100000:2.0:1783141824.263953:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047552 00000100:00100000:2.0:1783141824.263957:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047552 00000100:00100000:1.0:1783141824.263974:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141824.263983:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521046016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141824.264015:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521046016:12345-0@lo:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.264021:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141824.264053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521045760:0@lo:400:kworker.0 00000100:00100000:2.0:1783141824.265595:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783141824.265610:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521047552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141824.265632:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141824.265686:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521047552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.265694:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783141824.265753:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521046016:0@lo:400:kworker.0 00010000:00080000:2.0:1783141824.265767:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43577800 x1869759521046528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.265778:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521046528:0@lo:400:kworker.0 00010000:00080000:2.0:1783141824.265803:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a5180 x1869759521047040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.265812:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521047040:0@lo:400:kworker.0 00010000:00080000:2.0:1783141824.265822:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fed80 x1869759521047552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141824.265835:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521047552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141824.396416:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141824.770664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141824.770776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052032 00000100:00100000:3.0:1783141824.770786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052032 00000100:00100000:2.0:1783141824.770793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141824.770820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141824.770840:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052160 00000100:00100000:2.0:1783141824.770843:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052160 00000100:00100000:2.0:1783141824.770890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052288 00000100:00100000:2.0:1783141824.770894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052288 00000100:00100000:2.0:1783141824.770916:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:2.0:1783141824.770937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501052160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141824.771005:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501052160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.771013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:2.0:1783141824.771031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:2.0:1783141824.771038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501052288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141824.771066:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501052288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.771073:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1783141824.771130:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 286 00000100:00100000:3.0:1783141824.771138:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501052032:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141824.771171:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2403:x1869759501052032:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.771177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 286 00000100:00080000:2.0:1783141824.771497:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141824.771508:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141824.775633:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141824.775656:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521047680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141824.775726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.775857:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047680 00000100:00100000:2.0:1783141824.775865:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047680 00000100:00100000:2.0:1783141824.775913:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141824.775933:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521047680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783141824.775968:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783141824.776030:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521047680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.776037:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141824.776082:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521047680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141825.284903:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521047808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141825.284992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141825.286503:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047808 00000100:00100000:2.0:1783141825.286513:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047808 00000100:00100000:2.0:1783141825.286580:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783141825.286590:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521047808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141825.286618:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141825.286679:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521047808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141825.286686:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1783141825.289987:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fc380 x1869759521047808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141825.290026:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521047808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783141825.413198:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141825.806843:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521047936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141825.806912:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141825.806981:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521047936 00000100:00100000:2.0:1783141825.806989:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521047936 00000100:00100000:2.0:1783141825.807031:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783141825.807040:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521047936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141825.807061:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141825.807105:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521047936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141825.807124:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1783141825.807165:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fc380 x1869759521047936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141825.807194:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521047936:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783141826.438155:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141827.460537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141828.362805:0:12000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:10:27 (1783141827) === 00010000:00010000:2.0:1783141828.486186:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141828.813753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.819841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052416 00000100:00100000:2.0:1783141828.819856:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052416 00000100:00100000:2.0:1783141828.820001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:2.0:1783141828.820013:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:8732:x1869759501052416:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783141828.820030:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141828.820110:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e539 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141828.820141:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e539 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141828.820154:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e539 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141828.820163:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3600, rc 0) 00000100:00100000:2.0:1783141828.820317:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501052416:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 305us (6572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.820324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:2.0:1783141828.827518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.827621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052544 00000100:00100000:3.0:1783141828.827632:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052544 00000100:00100000:3.0:1783141828.827691:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 288 00000100:00100000:3.0:1783141828.827701:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501052544:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783141828.827866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501052544:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.827891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 288 00000100:00100000:0.0:1783141828.831216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.831313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052672 00000100:00100000:2.0:1783141828.831324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052672 00000100:00100000:2.0:1783141828.831389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 289 00000100:00100000:2.0:1783141828.831400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501052672:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783141828.831547:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501052672:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 148us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.831555:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 289 00000100:00100000:1.0:1783141828.840195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141828.840303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052800 00000100:00100000:0.0:1783141828.840312:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052800 00000100:00100000:0.0:1783141828.840569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 290 00000100:00100000:0.0:1783141828.840579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501052800:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141828.840747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501052800:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 168us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.840755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 290 00000100:00100000:0.0:1783141828.868112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.868572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501052928 00000100:00100000:3.0:1783141828.868581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501052928 00000100:00100000:1.0:1783141828.868631:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141828.868632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00100000:3.0:1783141828.868644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501052928:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141828.868652:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141828.868709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141828.868782:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048064 00000100:00100000:1.0:1783141828.868787:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048064 00000100:00100000:3.0:1783141828.868799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501052928:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 144us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.868809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00100000:1.0:1783141828.868824:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783141828.868833:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521048064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141828.868859:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141828.868899:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521048064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141828.868906:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783141828.868951:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141828.874265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141828.874631:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053056 00000100:00100000:0.0:1783141828.874641:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053056 00000100:00100000:0.0:1783141828.874700:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 292 00000100:00100000:0.0:1783141828.874711:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501053056:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141828.874855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8736:x1869759501053056:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 146us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.874864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 292 00000100:00100000:1.0:1783141828.889760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.889904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053184 00000100:00100000:3.0:1783141828.889915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053184 00000100:00100000:3.0:1783141828.890018:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:3.0:1783141828.890030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:8732:x1869759501053184:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783141828.890046:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141828.890061:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cd400/0xb31399d6a3806eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e56a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.890089:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cd400/0xb31399d6a3806eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e56a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.890099:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cd400/0xb31399d6a3806eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e56a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.890107:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd400, rc 0) 00000100:00100000:3.0:1783141828.890162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:8732:x1869759501053184:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.890169:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:1.0:1783141828.895135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.895389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053312 00000100:00100000:2.0:1783141828.895449:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053312 00000100:00100000:2.0:1783141828.895612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 294 00000100:00100000:2.0:1783141828.895622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:8732:x1869759501053312:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783141828.895647:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783141828.895669:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783141828.895674:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783141828.895677:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783141828.895680:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783141828.895682:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1783141828.898454:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:8732:x1869759501053312:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 2825us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.898476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 294 00000100:00100000:1.0:1783141828.902624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.902704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053440 00000100:00100000:3.0:1783141828.902714:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053440 00000100:00100000:3.0:1783141828.902765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:3.0:1783141828.902774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:8732:x1869759501053440:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783141828.902797:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141828.902813:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e571 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.902849:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.902860:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141828.902869:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd200, rc 0) 00000100:00100000:3.0:1783141828.902932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8732:x1869759501053440:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.902940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:1.0:1783141828.905239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.905527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053568 00000100:00100000:2.0:1783141828.905544:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053568 00000100:00100000:2.0:1783141828.905598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 296 00000100:00100000:2.0:1783141828.905606:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8732:x1869759501053568:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783141828.905746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8732:x1869759501053568:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 140us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.905754:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 296 00000100:00100000:1.0:1783141828.908402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141828.908498:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053696 00000100:00100000:0.0:1783141828.908507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053696 00000100:00100000:0.0:1783141828.908569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 297 00000100:00100000:0.0:1783141828.908578:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8732:x1869759501053696:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783141828.908718:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8732:x1869759501053696:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 140us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.908726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 297 00000100:00100000:1.0:1783141828.913201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.913323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053824 00000100:00100000:3.0:1783141828.913334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053824 00000100:00100000:3.0:1783141828.913379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 298 00000100:00100000:3.0:1783141828.913393:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8739:x1869759501053824:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141828.913548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8739:x1869759501053824:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 160us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.913556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 298 00000100:00100000:1.0:1783141828.916641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.916740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501053952 00000100:00100000:2.0:1783141828.916761:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501053952 00000100:00100000:2.0:1783141828.916819:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:2.0:1783141828.916828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8739:x1869759501053952:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141828.916980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:8739:x1869759501053952:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.916996:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:1.0:1783141828.923081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.923117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.923143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.923189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141828.923310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054720 00000100:00100000:0.0:1783141828.923319:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054720 00000100:00100000:0.0:1783141828.923377:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054848 00000100:00100000:0.0:1783141828.923381:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054848 00000100:00100000:0.0:1783141828.923392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054080 00000100:00100000:0.0:1783141828.923394:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054080 00000100:00100000:0.0:1783141828.923402:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054336 00000100:00100000:0.0:1783141828.923404:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054336 00000100:00100000:0.0:1783141828.923426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:0.0:1783141828.923436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501054720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141828.923509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501054720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.923517:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:0.0:1783141828.923543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:0.0:1783141828.923550:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501054848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141828.923577:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501054848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.923583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:0.0:1783141828.923594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783141828.923599:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1869759501054080:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783141828.923618:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 37e420ea-50f1-4924-a953-18d6b00f4d34@192.168.203.39@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:0.0:1783141828.923650:0:6523:0:(genops.c:1406:class_connect()) connect: client 37e420ea-50f1-4924-a953-18d6b00f4d34, cookie 0xb31399d6a3806ec1 00000004:00100000:0.0:1783141828.923673:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783141828.923777:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141828.923815:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2399:x1869759501054080:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 214us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.923822:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783141828.923834:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783141828.923839:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1869759501054336:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783141828.923853:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 37e420ea-50f1-4924-a953-18d6b00f4d34@192.168.203.39@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:0.0:1783141828.923875:0:6523:0:(genops.c:1406:class_connect()) connect: client 37e420ea-50f1-4924-a953-18d6b00f4d34, cookie 0xb31399d6a3806ec8 00000100:00080000:1.0:1783141828.924497:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141828.924503:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:0.0:1783141828.925470:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783141828.925614:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141828.925669:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2399:x1869759501054336:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 1827us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.925680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783141828.927598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.927640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.927708:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054208 00000100:00100000:3.0:1783141828.927717:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054208 00000100:00080000:1.0:1783141828.927951:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141828.927986:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054592 00000100:00100000:3.0:1783141828.927990:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054592 00000100:00100000:3.0:1783141828.928021:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141828.928030:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+7:0:x1869759501054208:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783141828.928066:0:11334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141828.928135:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+7:0:x1869759501054208:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 106us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.928143:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141828.928159:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783141828.928166:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501054592:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783141828.928176:0:11334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141828.928195:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501054592:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.928200:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1783141828.930117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.930204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054976 00000100:00100000:2.0:1783141828.930214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054976 00000100:00100000:2.0:1783141828.930267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1783141828.930468:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501054976:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783141828.930556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501054976:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 92us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141828.933836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.934009:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501054464 00000100:00100000:1.0:1783141828.934019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501054464 00000100:00080000:3.0:1783141828.934097:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141828.940729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141828.940766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141828.941151:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:1.0:1783141828.941187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1783141828.941202:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:0:x1869759501054464:12345-192.168.203.39@tcp:41:mount.lustre.0 00000100:00100000:2.0:1783141828.941207:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055360 00000100:00100000:2.0:1783141828.941214:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055360 00000004:00000024:1.0:1783141828.941239:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141828.941246:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783141828.941252:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501055360:12345-192.168.203.39@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783141828.941491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055104 00000100:00100000:0.0:1783141828.941496:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055104 00000100:00100000:0.0:1783141828.941519:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783141828.941524:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1869759501055104:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783141828.941557:0:8439:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 37e420ea-50f1-4924-a953-18d6b00f4d34@192.168.203.39@tcp t0 exp 0000000000000000 cur 340 last 0 00000100:00100000:2.0:1783141828.941626:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501055360:12345-192.168.203.39@tcp:900:mount.lustre.0 Request processed in 373us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141828.941634:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783141828.941669:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:0:x1869759501054464:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 473us (7841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141828.941675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:3.0:1783141828.941748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.941867:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055232 00000100:00100000:1.0:1783141828.941872:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055232 00000100:00100000:1.0:1783141828.941894:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1783141828.941923:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501055232:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783141828.941942:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 37e420ea-50f1-4924-a953-18d6b00f4d34@192.168.203.39@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1783141828.941963:0:8440:0:(genops.c:1406:class_connect()) connect: client 37e420ea-50f1-4924-a953-18d6b00f4d34, cookie 0xb31399d6a3806ed6 00002000:00100000:1.0:1783141828.941976:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 37e420ea-50f1-4924-a953-18d6b00f4d34/ffff9f9b42583000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141828.941992:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141828.942064:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783141828.942091:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f9b42586000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141828.942120:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2399:x1869759501055232:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141828.942127:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000020:00000080:0.0:1783141828.942183:0:8439:0:(genops.c:1406:class_connect()) connect: client 37e420ea-50f1-4924-a953-18d6b00f4d34, cookie 0xb31399d6a3806ecf 00002000:00100000:0.0:1783141828.942190:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 37e420ea-50f1-4924-a953-18d6b00f4d34/ffff9f9b43028000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141828.942202:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141828.942242:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783141828.942257:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141828.942419:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2399:x1869759501055104:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 891us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141828.942425:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1783141828.946786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141828.946947:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055488 00000100:00100000:1.0:1783141828.946958:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055488 00000100:00100000:1.0:1783141828.947073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:1.0:1783141828.947082:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501055488:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783141828.947165:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783141828.947251:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:8732:x1869759501055488:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 169us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141828.947258:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:1.0:1783141829.381807:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141829.381830:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141829.381906:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382506:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521048704:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382553:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382574:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521049216:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382615:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521049728:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382664:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783141829.382669:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521048320:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382716:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521048832:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382754:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521049344:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141829.382803:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048832 00000100:00100000:3.0:1783141829.382809:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048832 00000100:00100000:3.0:1783141829.382852:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141829.382860:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521048832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.382911:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521048832:12345-0@lo:400:kworker.0 Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.382919:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141829.382940:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049216 00000100:00100000:3.0:1783141829.382943:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049216 00000100:00100000:3.0:1783141829.382971:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049728 00000100:00100000:3.0:1783141829.382974:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049728 00000100:00100000:3.0:1783141829.383000:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049344 00000100:00100000:3.0:1783141829.383003:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049344 00000100:00100000:3.0:1783141829.383020:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783141829.383026:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.383056:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521049216:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.383062:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783141829.383087:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783141829.383094:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521049728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.383135:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521049728:12345-0@lo:400:kworker.0 Request processed in 42us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.383142:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783141829.383154:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783141829.383159:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.383182:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521049344:12345-0@lo:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.383188:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783141829.383206:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141829.383209:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141829.383237:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521048832:0@lo:400:kworker.0 00010000:00080000:3.0:1783141829.383248:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433ba680 x1869759521049344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141829.383258:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521049344:0@lo:400:kworker.0 00010000:00080000:3.0:1783141829.383267:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fc380 x1869759521049216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141829.383313:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521049216:0@lo:400:kworker.0 00010000:00080000:3.0:1783141829.383324:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433bad80 x1869759521049728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141829.383331:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521049728:0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.383360:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048704 00000100:00100000:3.0:1783141829.383363:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048704 00000100:00100000:3.0:1783141829.383386:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783141829.383620:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.383667:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521048704:12345-0@lo:400:kworker.0 Request processed in 50us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.383673:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783141829.383700:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521048704:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.384025:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048192 00000100:00100000:0.0:1783141829.384029:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048192 00000100:00100000:0.0:1783141829.384088:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783141829.384096:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521048192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141829.384112:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141829.384147:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521048192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141829.384153:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783141829.384180:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521048576:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.384217:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141829.384241:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521049088:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.384262:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141829.384312:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521049600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.384333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141829.384354:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783141829.384361:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521048448:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.384382:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783141829.384655:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141829.384717:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521049856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141829.384748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783141829.384779:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4e00 x1869759521048192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141829.384813:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141829.384839:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049856 00000100:00100000:1.0:1783141829.384842:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049856 00000100:00100000:1.0:1783141829.384868:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141829.384875:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521049856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141829.384887:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141829.384919:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521049856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141829.384924:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1783141829.384954:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fe680 x1869759521049856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141829.384966:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521049856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141829.385099:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521048960:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.385125:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141829.390344:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048576 00000100:00100000:1.0:1783141829.390357:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048576 00000100:00100000:1.0:1783141829.390419:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783141829.390429:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521048576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141829.390520:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521048576:12345-0@lo:400:kworker.0 Request processed in 92us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141829.390528:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783141829.394803:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521049472:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.394863:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141829.395065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049088 00000100:00100000:2.0:1783141829.395688:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049088 00000100:00100000:2.0:1783141829.395750:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049600 00000100:00100000:2.0:1783141829.395754:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049600 00000100:00100000:2.0:1783141829.395784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048448 00000100:00100000:2.0:1783141829.395787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048448 00000100:00100000:2.0:1783141829.395797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048960 00000100:00100000:2.0:1783141829.395799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048960 00000100:00100000:2.0:1783141829.395813:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783141829.395821:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521049088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141829.395892:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521049088:12345-0@lo:400:kworker.0 Request processed in 72us (11628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141829.395899:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783141829.395915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783141829.395921:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521049600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141829.395950:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521049600:12345-0@lo:400:kworker.0 Request processed in 29us (11615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141829.395955:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783141829.395966:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783141829.395972:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521048448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141829.396502:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521048448:12345-0@lo:400:kworker.0 Request processed in 528us (12117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141829.396509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783141829.396524:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783141829.396541:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521048960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141829.396573:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521048960:12345-0@lo:400:kworker.0 Request processed in 42us (11447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141829.396578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1783141829.396600:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141829.396604:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141829.396713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521048320 00000100:00100000:2.0:1783141829.396725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521048320 00000100:00100000:2.0:1783141829.396758:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783141829.396764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521048320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141829.396802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521048320:12345-0@lo:400:kworker.0 Request processed in 39us (14106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141829.396808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1783141829.396864:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521048320:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.398476:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521048576:0@lo:400:kworker.0 00010000:00080000:0.0:1783141829.398497:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43576d80 x1869759521049088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141829.398507:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521049088:0@lo:400:kworker.0 00010000:00080000:0.0:1783141829.398518:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433bb800 x1869759521049600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141829.398527:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521049600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.398569:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521048448:0@lo:400:kworker.0 00000100:00100000:0.0:1783141829.398580:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521048960:0@lo:400:kworker.0 00000100:00100000:1.0:1783141829.398643:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049472 00000100:00100000:1.0:1783141829.398650:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049472 00000100:00100000:3.0:1783141829.398742:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783141829.398752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521049472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141829.398818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521049472:12345-0@lo:400:kworker.0 Request processed in 69us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141829.398825:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1783141829.398877:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141829.398906:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521049472:0@lo:400:kworker.0 00010000:00010000:1.0:1783141829.508524:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141829.897853:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141829.897874:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521049984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141829.898175:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141829.898419:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521049984 00000100:00100000:1.0:1783141829.898428:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521049984 00000100:00100000:1.0:1783141829.898481:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783141829.898490:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521049984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141829.898549:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783141829.898603:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521049984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141829.898611:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783141829.898654:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521049984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141830.404699:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141830.404722:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521050112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141830.404790:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141830.404988:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050112 00000100:00100000:3.0:1783141830.404996:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050112 00000100:00100000:3.0:1783141830.405048:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783141830.405058:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521050112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141830.405091:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141830.405146:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521050112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141830.405154:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1783141830.405305:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f80ca80 x1869759521050112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141830.405323:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521050112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141830.547417:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141830.916427:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521050240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141830.916495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141830.916613:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050240 00000100:00100000:0.0:1783141830.916621:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050240 00000100:00100000:0.0:1783141830.916673:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783141830.916683:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521050240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141830.916710:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141830.920241:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521050240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3551us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141830.920255:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1783141830.924849:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b8a80 x1869759521050240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141830.924943:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521050240:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141831.559939:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141832.580949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141833.605314:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141833.985996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141833.986177:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056384 00000100:00100000:3.0:1783141833.986188:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056384 00000100:00100000:3.0:1783141833.986250:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1783141833.986261:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141833.986357:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141833.986365:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1783141833.986408:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055872 00000100:00100000:3.0:1783141833.986412:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055872 00000100:00100000:3.0:1783141833.986440:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056128 00000100:00100000:3.0:1783141833.986444:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056128 00000100:00100000:3.0:1783141833.986472:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055744 00000100:00100000:3.0:1783141833.986475:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055744 00000100:00100000:3.0:1783141833.986493:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056000 00000100:00100000:3.0:1783141833.986496:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056000 00000100:00100000:3.0:1783141833.986526:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:3.0:1783141833.986533:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501055872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141833.986567:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501055872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141833.986574:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:3.0:1783141833.986600:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:3.0:1783141833.986607:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141833.986635:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141833.986642:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:3.0:1783141833.986656:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:3.0:1783141833.986662:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501055744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141833.986686:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501055744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141833.986691:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:3.0:1783141833.986704:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:3.0:1783141833.986712:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141833.986736:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141833.986742:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00080000:3.0:1783141833.986765:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141833.986770:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141833.986772:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141833.989675:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141833.989808:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056256 00000100:00100000:2.0:1783141833.989817:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056256 00000100:00100000:2.0:1783141833.989889:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:2.0:1783141833.989898:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141833.990069:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501056256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 172us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141833.990077:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00080000:3.0:1783141833.990610:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141833.990867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501055616 00000100:00100000:0.0:1783141833.990875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501055616 00000100:00100000:0.0:1783141833.990988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 301 00000100:00100000:0.0:1783141833.990997:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501055616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141833.991044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501055616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141833.991050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 301 00000100:00100000:3.0:1783141833.991225:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141833.991240:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521050368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141833.991304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141833.991761:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050368 00000100:00100000:2.0:1783141833.991766:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050368 00000100:00100000:2.0:1783141833.991813:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783141833.991819:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521050368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141833.991843:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141833.991894:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521050368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141833.991900:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141833.992098:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521050368:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1783141834.102053:0:12193:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1783141834.500616:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141834.500640:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141834.500708:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141834.500795:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050496 00000100:00100000:1.0:1783141834.500803:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050496 00000100:00100000:1.0:1783141834.500855:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783141834.500864:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521050496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141834.500892:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141834.500935:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521050496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00080000:3.0:1783141834.501040:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141834.501226:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521050624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141834.501266:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141834.501392:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1783141834.501697:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4e00 x1869759521050496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.501716:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141834.501849:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521050880:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.501878:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.501904:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521051392:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.501925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502047:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521051904:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502093:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783141834.502098:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521050752:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502140:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521051264:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502174:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521051776:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502211:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050880 00000100:00100000:0.0:1783141834.502215:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050880 00000100:00100000:0.0:1783141834.502244:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051392 00000100:00100000:0.0:1783141834.502246:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051392 00000100:00100000:0.0:1783141834.502265:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051904 00000100:00100000:0.0:1783141834.502267:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051904 00000100:00100000:0.0:1783141834.502388:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051264 00000100:00100000:0.0:1783141834.502391:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051264 00000100:00100000:0.0:1783141834.502402:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051776 00000100:00100000:0.0:1783141834.502413:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051776 00000100:00100000:0.0:1783141834.502433:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783141834.502439:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521050880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502485:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521050880:12345-0@lo:400:kworker.0 Request processed in 45us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.502492:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783141834.502518:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783141834.502524:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521051392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502554:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521051392:12345-0@lo:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.502560:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783141834.502570:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783141834.502576:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521051904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502600:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521051904:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.502605:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783141834.502614:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783141834.502619:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521051264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502642:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521051264:12345-0@lo:400:kworker.0 Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.502649:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783141834.502659:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783141834.502664:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521051776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502686:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521051776:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.502700:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1783141834.502716:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141834.502719:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141834.502742:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521051264:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502751:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521051776:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502759:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521050880:0@lo:400:kworker.0 00010000:00080000:0.0:1783141834.502769:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4e00 x1869759521051392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.502778:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521051392:0@lo:400:kworker.0 00010000:00080000:0.0:1783141834.502788:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a1180 x1869759521051904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.502796:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521051904:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502825:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521051136:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.502849:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.502865:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521051648:0@lo:400:kworker.0 00000100:00100000:1.0:1783141834.502981:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050624 00000100:00100000:1.0:1783141834.502986:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050624 00000100:00100000:1.0:1783141834.503019:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783141834.503025:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521050624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141834.503039:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141834.503126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141834.503190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521050752 00000100:00100000:2.0:1783141834.503194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521050752 00000100:00100000:2.0:1783141834.503232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783141834.503239:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521050752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141834.503425:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051136 00000100:00100000:3.0:1783141834.503429:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051136 00000100:00100000:3.0:1783141834.503453:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783141834.503460:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141834.503603:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521050624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 577us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141834.503610:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783141834.503629:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141834.503656:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051648 00000100:00100000:1.0:1783141834.503666:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051648 00000100:00100000:1.0:1783141834.503697:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141834.503702:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141834.503734:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521051648:12345-0@lo:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141834.503740:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1783141834.503753:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141834.503891:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a0000 x1869759521051648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.503905:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521051648:0@lo:400:kworker.0 00010000:00080000:0.0:1783141834.503916:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dd500 x1869759521050624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.503929:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521050624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141834.504057:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783141834.504066:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521051008:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.504097:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.504249:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521051520:0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.504297:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141834.504338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051008 00000100:00100000:0.0:1783141834.504342:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051008 00000100:00100000:0.0:1783141834.504372:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141834.504379:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141834.504417:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521051008:12345-0@lo:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141834.504423:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141834.504449:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521051008:0@lo:400:kworker.0 00000100:00100000:1.0:1783141834.504587:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521051520 00000100:00100000:1.0:1783141834.504592:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521051520 00000100:00100000:1.0:1783141834.504633:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141834.504639:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141834.504676:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521051520:12345-0@lo:400:kworker.0 Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141834.504681:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783141834.504747:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141834.504766:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a3480 x1869759521051520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141834.504777:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521051520:0@lo:400:kworker.0 00000100:00100000:2.0:1783141834.505089:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521050752:12345-0@lo:400:kworker.0 Request processed in 1849us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141834.505099:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783141834.505186:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521050752:0@lo:400:kworker.0 00000100:00100000:3.0:1783141834.505433:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521051136:12345-0@lo:400:kworker.0 Request processed in 1969us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141834.505441:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783141834.505513:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521051136:0@lo:400:kworker.0 00010000:00010000:2.0:1783141834.629564:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141835.013007:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521052032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141835.013090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141835.015601:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052032 00000100:00100000:3.0:1783141835.015719:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052032 00000100:00100000:3.0:1783141835.015771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783141835.015779:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521052032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141835.016439:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141835.016532:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521052032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 752us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141835.016540:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000001:00100000:3.0:1783141835.017681:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000100:00100000:3.0:1783141835.017741:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521052032:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1783141835.027658:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00100000:0.0:1783141835.034758:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00100000:2.0:1783141835.044626:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000100:00100000:1.0:1783141835.539201:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141835.547258:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521052160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141835.547359:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141835.547607:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052160 00000100:00100000:3.0:1783141835.547615:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052160 00000100:00100000:3.0:1783141835.547670:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141835.547678:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521052160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141835.547708:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141835.547762:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521052160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141835.547769:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1783141835.547878:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43575880 x1869759521052160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141835.547900:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521052160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141835.652847:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141836.038150:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521052288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141836.038225:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141836.038317:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052288 00000100:00100000:3.0:1783141836.038324:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052288 00000100:00100000:3.0:1783141836.038395:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141836.038404:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521052288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141836.038427:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141836.038468:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521052288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141836.038475:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1783141836.038504:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141836.038534:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bea00 x1869759521052288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141836.038552:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521052288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141836.679558:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141837.700396:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141838.726937:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141839.109451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141839.110535:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521052416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141839.110602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141839.110698:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052416 00000100:00100000:1.0:1783141839.110707:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052416 00000100:00100000:1.0:1783141839.110798:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783141839.110809:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521052416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141839.110845:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141839.110918:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521052416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.110936:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783141839.112930:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521052416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141839.114733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141839.114911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141839.117826:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056512 00000100:00100000:2.0:1783141839.117839:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056512 00000100:00100000:2.0:1783141839.117912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 303 00000100:00100000:2.0:1783141839.117921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501056512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141839.117987:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501056512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141839.117994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 303 00000100:00100000:1.0:1783141839.121867:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056640 00000100:00100000:1.0:1783141839.121893:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056640 00000100:00100000:1.0:1783141839.121968:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056768 00000100:00100000:1.0:1783141839.121971:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056768 00000100:00100000:1.0:1783141839.121984:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057024 00000100:00100000:1.0:1783141839.121987:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057024 00000100:00100000:1.0:1783141839.121998:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501056896 00000100:00100000:1.0:1783141839.122000:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501056896 00000100:00100000:1.0:1783141839.122019:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:1.0:1783141839.122029:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501056640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122110:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501056640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (7344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122117:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:1.0:1783141839.122134:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:1.0:1783141839.122140:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501056768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122165:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501056768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (7369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122171:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:1.0:1783141839.122180:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:1.0:1783141839.122186:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122204:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (7377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122210:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:1.0:1783141839.122220:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:1.0:1783141839.122234:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501056896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122257:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501056896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122263:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:1.0:1783141839.122315:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057280 00000100:00100000:1.0:1783141839.122319:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057280 00000100:00100000:1.0:1783141839.122343:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057152 00000100:00100000:1.0:1783141839.122346:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057152 00000100:00100000:1.0:1783141839.122364:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1783141839.122370:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122393:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (7540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122399:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1783141839.122409:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1783141839.122415:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141839.122436:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501057152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (7525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.122441:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00080000:2.0:1783141839.122931:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141839.122936:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141839.122939:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141839.122949:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141839.620737:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141839.620759:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521052544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141839.620827:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141839.620926:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052544 00000100:00100000:0.0:1783141839.620946:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052544 00000100:00100000:0.0:1783141839.621008:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783141839.621018:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521052544:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783141839.621019:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1783141839.621054:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141839.621109:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521052544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.621115:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783141839.621301:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521052672:0@lo:400:kworker.0 00000100:00100000:1.0:1783141839.621305:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521052800:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.621342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141839.621360:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141839.621373:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521053184:0@lo:400:kworker.0 00000100:00100000:1.0:1783141839.621388:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521053312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.621399:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141839.621434:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052800 00000100:00100000:1.0:1783141839.621439:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052800 00000100:00100000:1.0:1783141839.621481:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053184 00000100:00100000:1.0:1783141839.621484:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053184 00000100:00100000:2.0:1783141839.621498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052672 00000100:00100000:2.0:1783141839.621504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052672 00000100:00100000:1.0:1783141839.621522:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783141839.621532:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521052800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141839.621538:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783141839.621549:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521052672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.621595:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521052928:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.624302:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521053696:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.624356:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783141839.624392:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a3480 x1869759521052544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141839.624413:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521052544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141839.624435:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141839.624441:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521053056:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.624472:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141839.624483:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521053568:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.624502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141839.624546:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053696 00000100:00100000:3.0:1783141839.624551:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053696 00000100:00100000:1.0:1783141839.624565:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521052800:12345-0@lo:400:kworker.0 Request processed in 3033us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.624576:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783141839.624598:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053056 00000100:00100000:1.0:1783141839.624602:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053056 00000100:00100000:2.0:1783141839.624680:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521052672:12345-0@lo:400:kworker.0 Request processed in 3132us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.624688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141839.624695:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1783141839.624721:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521053440:0@lo:400:kworker.0 00000100:00080000:2.0:1783141839.624748:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141839.624748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141839.624767:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521053952:0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.624791:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141839.624799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141839.624825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521052928 00000100:00100000:0.0:1783141839.624830:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521052928 00000100:00100000:0.0:1783141839.624853:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141839.624871:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521052928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.624924:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521052928:12345-0@lo:400:kworker.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.624930:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141839.624949:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053568 00000100:00100000:0.0:1783141839.624952:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053568 00000100:00100000:0.0:1783141839.624987:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053440 00000100:00100000:0.0:1783141839.624990:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053440 00000100:00100000:3.0:1783141839.625008:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053312 00000100:00100000:0.0:1783141839.625009:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053952 00000100:00100000:3.0:1783141839.625015:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053312 00000100:00100000:0.0:1783141839.625015:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053952 00000100:00100000:0.0:1783141839.625050:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783141839.625054:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783141839.625061:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521053568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.625066:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521053184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.625110:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521053184:12345-0@lo:400:kworker.0 Request processed in 47us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141839.625117:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783141839.625122:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521053568:12345-0@lo:400:kworker.0 Request processed in 61us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141839.625138:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783141839.625145:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521053696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.625173:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521053696:12345-0@lo:400:kworker.0 Request processed in 29us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141839.625178:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783141839.625200:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783141839.625215:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783141839.625222:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625252:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521053440:12345-0@lo:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.625258:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783141839.625269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141839.625337:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521053952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625367:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521053952:12345-0@lo:400:kworker.0 Request processed in 33us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.625373:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141839.625399:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521054080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141839.625425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783141839.625452:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141839.625455:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141839.625469:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141839.625490:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521052928:0@lo:400:kworker.0 00010000:00080000:0.0:1783141839.625500:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bd180 x1869759521053440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141839.625510:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521053440:0@lo:400:kworker.0 00010000:00080000:0.0:1783141839.625518:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bca80 x1869759521053952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141839.625525:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521053952:0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783141839.625578:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625609:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521053312:12345-0@lo:400:kworker.0 Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.625616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783141839.625624:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521053824:0@lo:400:kworker.0 00000100:00100000:2.0:1783141839.625658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141839.625691:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521052800:0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521053824 00000100:00100000:0.0:1783141839.625698:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521053824 00010000:00080000:2.0:1783141839.625706:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bce00 x1869759521053312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141839.625715:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521053312:0@lo:400:kworker.0 00000100:00100000:0.0:1783141839.625730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783141839.625738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521053824:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783141839.625779:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436be300 x1869759521053568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141839.625788:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521053568:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.625810:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054080 00000100:00100000:3.0:1783141839.625815:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054080 00000100:00100000:0.0:1783141839.625833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521053824:12345-0@lo:400:kworker.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141839.625842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783141839.625851:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783141839.625859:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521054080:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783141839.625862:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:3.0:1783141839.625875:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141839.625878:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521052672:0@lo:400:kworker.0 00000100:00100000:2.0:1783141839.625893:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521053184:0@lo:400:kworker.0 00000100:00100000:2.0:1783141839.625905:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521053696:0@lo:400:kworker.0 00000100:00100000:3.0:1783141839.625995:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521054080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141839.626004:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1783141839.626013:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433b9500 x1869759521054080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141839.626030:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521054080:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783141839.626039:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bd500 x1869759521053824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141839.626062:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521053824:0@lo:400:kworker.0 00000100:00100000:1.0:1783141839.626231:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783141839.626240:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141839.626397:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521053056:12345-0@lo:400:kworker.0 Request processed in 158us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141839.626405:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783141839.626408:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521053056:0@lo:400:kworker.0 00010000:00010000:3.0:1783141839.748501:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141840.134611:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521054208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141840.134676:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141840.134746:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054208 00000100:00100000:1.0:1783141840.134753:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054208 00000100:00100000:1.0:1783141840.134797:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783141840.134807:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521054208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141840.134839:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783141840.134882:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521054208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141840.134890:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783141840.134949:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521054208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141840.646499:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521054336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141840.646572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141840.651447:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054336 00000100:00100000:0.0:1783141840.651470:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054336 00000100:00100000:0.0:1783141840.651562:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141840.651573:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521054336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141840.651606:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141840.651691:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521054336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (5119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141840.651711:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1783141840.651776:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43284e00 x1869759521054336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141840.651796:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521054336:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1783141840.652508:0:12508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783141840.652734:0:12508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141840.772406:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141841.157213:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521054464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141841.157311:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141841.158072:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054464 00000100:00100000:1.0:1783141841.158093:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054464 00000100:00100000:1.0:1783141841.158171:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783141841.158182:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521054464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141841.158206:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141841.158259:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521054464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141841.158267:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1783141841.158320:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141841.158352:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436be680 x1869759521054464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141841.158371:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521054464:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141841.796508:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783141842.432125:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141842.432426:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783141842.822793:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141843.844444:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141844.227187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141844.227221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141844.227240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141844.227260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141844.227301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141844.227330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057408 00000100:00100000:2.0:1783141844.227339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057408 00000100:00100000:2.0:1783141844.227387:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 305 00000100:00100000:2.0:1783141844.227398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501057408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141844.227472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501057408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.227479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 305 00000100:00100000:2.0:1783141844.227518:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057664 00000100:00100000:2.0:1783141844.227521:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057664 00000100:00100000:2.0:1783141844.227556:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057920 00000100:00100000:2.0:1783141844.227559:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057920 00000100:00100000:2.0:1783141844.227579:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057536 00000100:00100000:2.0:1783141844.227581:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057536 00000100:00100000:2.0:1783141844.227599:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:2.0:1783141844.227621:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501057664:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141844.227653:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501057664:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.227660:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:2.0:1783141844.227690:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:2.0:1783141844.227698:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501057920:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141844.227726:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501057920:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.227732:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:2.0:1783141844.227747:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:2.0:1783141844.227753:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501057536:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141844.227774:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501057536:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.227779:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:2.0:1783141844.227803:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058176 00000100:00100000:2.0:1783141844.227807:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058176 00000100:00100000:2.0:1783141844.227834:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:2.0:1783141844.227840:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501058176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141844.227866:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501058176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.227880:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00080000:2.0:1783141844.228003:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141844.228007:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141844.228009:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141844.229186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141844.229225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141844.229306:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501057792 00000100:00100000:3.0:1783141844.229313:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501057792 00000100:00100000:3.0:1783141844.229358:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00100000:3.0:1783141844.229367:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501057792:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141844.229418:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501057792:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.229435:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00080000:1.0:1783141844.229805:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141844.230003:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058048 00000100:00100000:0.0:1783141844.230008:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058048 00000100:00100000:0.0:1783141844.230057:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783141844.230065:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501058048:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141844.230105:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501058048:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141844.230112:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00080000:1.0:1783141844.230842:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141844.234089:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521054592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141844.234159:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.235532:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054592 00000100:00100000:2.0:1783141844.235545:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054592 00000100:00100000:2.0:1783141844.235602:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783141844.235611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c669b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521054592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141844.235646:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141844.239130:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c669b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521054592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3511us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.239144:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783141844.239364:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521054592:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1783141844.408393:0:12703:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783141844.408672:0:12703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783141844.740417:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141844.740449:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521054720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141844.740532:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.740595:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054720 00000100:00100000:3.0:1783141844.740602:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054720 00000100:00100000:3.0:1783141844.740653:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783141844.740661:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521054720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783141844.740689:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141844.740730:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521054720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.740750:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1783141844.740951:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783141844.740980:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43286300 x1869759521054720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141844.740997:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521054720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141844.741611:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521055232:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.741676:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521055744:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.741719:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783141844.741724:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521055104:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741790:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.741807:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521055616:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741827:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.741843:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521056128:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741862:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141844.741887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055232 00000100:00100000:3.0:1783141844.741893:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055232 00000100:00100000:3.0:1783141844.741928:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783141844.741935:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521055232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.741975:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521055232:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.741981:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783141844.742001:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055744 00000100:00100000:3.0:1783141844.742011:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055744 00000100:00100000:3.0:1783141844.742041:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055616 00000100:00100000:3.0:1783141844.742044:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055616 00000100:00100000:3.0:1783141844.742068:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056128 00000100:00100000:3.0:1783141844.742071:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056128 00000100:00100000:3.0:1783141844.742087:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141844.742093:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521055744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.742122:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521055744:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.742128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141844.742139:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141844.742144:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521055616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.742167:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521055616:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.742173:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141844.742182:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141844.742187:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521056128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.742209:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521056128:12345-0@lo:400:kworker.0 Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.742215:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141844.742231:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055104 00000100:00100000:3.0:1783141844.742234:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055104 00000100:00100000:3.0:1783141844.742256:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783141844.742262:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.742317:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521055104:12345-0@lo:400:kworker.0 Request processed in 55us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141844.742322:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783141844.742355:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141844.742359:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141844.742384:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521055104:0@lo:400:kworker.0 00010000:00080000:3.0:1783141844.742396:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43284000 x1869759521055616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141844.742404:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521055616:0@lo:400:kworker.0 00010000:00080000:3.0:1783141844.742413:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b437fd180 x1869759521056128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141844.742420:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521056128:0@lo:400:kworker.0 00000100:00100000:3.0:1783141844.742439:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521055232:0@lo:400:kworker.0 00010000:00080000:3.0:1783141844.742449:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43287480 x1869759521055744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141844.742456:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521055744:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742545:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521054848:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742608:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521055360:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742647:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521055872:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742686:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783141844.742692:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521054976:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742727:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521055488:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742759:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521056000:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.742801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054848 00000100:00100000:2.0:1783141844.742805:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054848 00000100:00100000:2.0:1783141844.742834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783141844.742841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.742875:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521054848:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.742888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783141844.742916:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055360 00000100:00100000:2.0:1783141844.742920:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055360 00000100:00100000:2.0:1783141844.742941:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055872 00000100:00100000:2.0:1783141844.742944:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055872 00000100:00100000:2.0:1783141844.742954:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521054976 00000100:00100000:2.0:1783141844.742957:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521054976 00000100:00100000:2.0:1783141844.742967:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521055488 00000100:00100000:2.0:1783141844.742968:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521055488 00000100:00100000:2.0:1783141844.742979:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056000 00000100:00100000:2.0:1783141844.742982:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056000 00000100:00100000:2.0:1783141844.742994:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783141844.743000:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743030:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521055360:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.743035:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783141844.743045:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783141844.743050:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521055872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743073:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521055872:12345-0@lo:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.743079:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783141844.743089:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783141844.743094:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743118:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521054976:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.743123:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783141844.743134:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783141844.743147:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743176:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521055488:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.743182:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783141844.743193:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783141844.743199:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521056000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743223:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521056000:12345-0@lo:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.743228:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1783141844.743253:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141844.743256:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141844.743300:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521054976:0@lo:400:kworker.0 00010000:00080000:2.0:1783141844.743311:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43286680 x1869759521055488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141844.743320:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521055488:0@lo:400:kworker.0 00010000:00080000:2.0:1783141844.743329:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43284e00 x1869759521056000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141844.743336:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521056000:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743343:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521054848:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743352:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521055360:0@lo:400:kworker.0 00000100:00100000:2.0:1783141844.743360:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521055872:0@lo:400:kworker.0 00000100:00100000:1.0:1783141844.748106:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141844.748128:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521056256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141844.748194:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141844.748464:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056256 00000100:00100000:2.0:1783141844.748471:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056256 00000100:00100000:2.0:1783141844.748536:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783141844.748544:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521056256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141844.748566:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141844.748618:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521056256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141844.748625:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1783141844.748667:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433bb800 x1869759521056256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141844.748691:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521056256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141844.868607:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141845.259698:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521056384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141845.259769:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141845.262065:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056384 00000100:00100000:3.0:1783141845.262078:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056384 00000100:00100000:3.0:1783141845.262140:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783141845.262149:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521056384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141845.262183:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141845.262260:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521056384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141845.262268:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783141845.262388:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521056384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141845.764572:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141845.764593:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521056512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141845.764660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141845.764736:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056512 00000100:00100000:0.0:1783141845.764744:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056512 00000100:00100000:0.0:1783141845.764796:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783141845.764805:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521056512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141845.764842:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141845.764899:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521056512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141845.764907:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1783141845.764949:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dc700 x1869759521056512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141845.764967:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521056512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141845.892448:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141846.276825:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521056640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141846.277077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141846.277121:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056640 00000100:00100000:1.0:1783141846.277138:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056640 00000100:00100000:1.0:1783141846.277198:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783141846.277208:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521056640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141846.277230:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141846.277304:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521056640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141846.277318:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1783141846.277381:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bd500 x1869759521056640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141846.277399:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521056640:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783141846.277516:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1783141846.278184:0:12800:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141846.278637:0:12800:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783141846.917026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783141847.891845:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141847.892080:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783141847.941903:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141848.964717:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141849.363687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141849.363727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141849.363744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141849.363766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141849.363772:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058944 00000100:00100000:3.0:1783141849.363779:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058944 00000100:00100000:1.0:1783141849.363781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141849.363827:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059072 00000100:00100000:3.0:1783141849.363831:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059072 00000100:00100000:1.0:1783141849.363874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141849.363921:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1783141849.363931:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2399:x1869759501058944:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1783141849.363958:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ecf 00000100:00080000:3.0:1783141849.363965:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141849.364006:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783141849.364208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141849.364954:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+2:2399:x1869759501058944:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 1022us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141849.364964:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1783141849.364984:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:3.0:1783141849.364993:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2399:x1869759501059072:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1783141849.365007:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ed6 00000100:00080000:3.0:1783141849.365014:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b42586000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141849.365039:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783141849.365248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058304 00000100:00100000:2.0:1783141849.365254:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058304 00000100:00100000:2.0:1783141849.365302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 307 00000100:00100000:2.0:1783141849.365309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501058304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141849.365338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501058304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.365345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 307 00000100:00100000:2.0:1783141849.365371:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058560 00000100:00100000:2.0:1783141849.365375:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058560 00000100:00100000:2.0:1783141849.365418:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058816 00000100:00100000:2.0:1783141849.365421:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058816 00000100:00100000:2.0:1783141849.365434:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058432 00000100:00100000:2.0:1783141849.365436:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058432 00000100:00100000:2.0:1783141849.365446:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501058688 00000100:00100000:2.0:1783141849.365448:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501058688 00000100:00100000:2.0:1783141849.365460:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:2.0:1783141849.365465:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501058560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141849.365491:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501058560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.365502:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:2.0:1783141849.365529:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:2.0:1783141849.365535:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501058816:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141849.365559:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501058816:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.365565:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:2.0:1783141849.365575:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:2.0:1783141849.365580:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501058432:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141849.365600:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501058432:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.365606:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:2.0:1783141849.365901:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:2.0:1783141849.365913:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501058688:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141849.365940:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501058688:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.365947:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:3.0:1783141849.366990:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+2:2399:x1869759501059072:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 125us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141849.367004:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:3.0:1783141849.367037:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521056768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141849.367087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141849.367164:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141849.367170:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141849.367173:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141849.367176:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783141849.367201:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141849.367334:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056768 00000100:00100000:0.0:1783141849.367341:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056768 00000100:00100000:0.0:1783141849.367371:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783141849.367378:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521056768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783141849.367416:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783141849.368021:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521056768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 412us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.368030:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:3.0:1783141849.368143:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141849.368504:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521056768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141849.860520:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521057024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141849.860537:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521057152:0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.860590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141849.860590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141849.861333:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141849.861343:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521057536:0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.861443:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141849.861455:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521056896:0@lo:400:kworker.0 00000100:00100000:1.0:1783141849.861488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141849.861512:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141849.861518:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141849.861541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141849.861566:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057152 00000100:00100000:1.0:1783141849.861571:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057024 00000100:00100000:2.0:1783141849.861573:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057152 00000100:00100000:1.0:1783141849.861573:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057024 00000100:00100000:2.0:1783141849.861608:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057536 00000100:00100000:1.0:1783141849.861608:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057664 00000100:00100000:2.0:1783141849.861611:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057536 00000100:00100000:1.0:1783141849.861611:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057664 00000100:00100000:1.0:1783141849.861626:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783141849.861627:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783141849.861633:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521057024:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141849.861644:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521057152:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1783141849.861659:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141849.861694:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521057024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141849.861702:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141849.861719:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141849.861726:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521057664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141849.861736:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141849.861747:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521057152:12345-0@lo:400:kworker.0 Request processed in 40us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.861754:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783141849.861758:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521057664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141849.861763:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783141849.861769:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783141849.861775:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521057536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783141849.861778:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141849.861781:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141849.861802:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521057536:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00010000:00080000:1.0:1783141849.861804:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433bb800 x1869759521057664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141849.861808:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783141849.861821:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141849.861824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521056896 00000100:00100000:2.0:1783141849.861827:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521056896 00000100:00100000:2.0:1783141849.861850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783141849.861856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521056896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.861884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521056896:12345-0@lo:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.861891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783141849.861933:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521057536:0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.861943:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521057152:0@lo:400:kworker.0 00010000:00080000:1.0:1783141849.861967:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43285180 x1869759521057024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141849.861982:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521057024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141849.861994:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521056896:0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862078:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521057280:0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.862173:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521057792:0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862206:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.862234:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521058304:0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862256:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.862297:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783141849.862304:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521057408:0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.862340:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521057920:0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.862396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057792 00000100:00100000:2.0:1783141849.862400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057792 00000100:00100000:0.0:1783141849.862478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.862526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058304 00000100:00100000:0.0:1783141849.862530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058304 00000100:00100000:0.0:1783141849.862559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057408 00000100:00100000:0.0:1783141849.862562:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057408 00000100:00100000:0.0:1783141849.862577:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783141849.862583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521058304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862616:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521058304:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.862622:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783141849.862633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783141849.862638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521057408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862664:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521057408:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.862670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783141849.862699:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057920 00000100:00100000:0.0:1783141849.862703:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057920 00000100:00100000:0.0:1783141849.862729:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783141849.862735:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.862763:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521057920:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.862779:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1783141849.862796:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141849.862800:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141849.862821:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521057408:0@lo:400:kworker.0 00010000:00080000:0.0:1783141849.862831:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6ddc00 x1869759521057920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141849.862840:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521057920:0@lo:400:kworker.0 00010000:00080000:0.0:1783141849.862849:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6df480 x1869759521058304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141849.862857:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521058304:0@lo:400:kworker.0 00000100:00100000:1.0:1783141849.863060:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521058048:0@lo:400:kworker.0 00000100:00100000:1.0:1783141849.863088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141849.863117:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141849.863123:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521058176:0@lo:400:kworker.0 00000100:00100000:1.0:1783141849.863144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141849.863211:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058048 00000100:00100000:0.0:1783141849.863215:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058048 00000100:00100000:0.0:1783141849.863300:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141849.863308:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.863346:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521058048:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.863364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141849.863383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058176 00000100:00100000:0.0:1783141849.863396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058176 00000100:00100000:3.0:1783141849.863603:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521057280 00000100:00100000:3.0:1783141849.863608:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521057280 00000100:00100000:3.0:1783141849.863637:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783141849.863643:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521057280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141849.863696:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521057280:12345-0@lo:400:kworker.0 Request processed in 42us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141849.863702:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783141849.863733:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521057280:0@lo:400:kworker.0 00000100:00080000:1.0:1783141849.863845:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141849.863849:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141849.863947:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783141849.863955:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521058176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141849.863987:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521058176:12345-0@lo:400:kworker.0 Request processed in 33us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141849.863993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783141849.864030:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521058176:0@lo:400:kworker.0 00010000:00080000:0.0:1783141849.864042:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6ddf80 x1869759521058048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141849.864052:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521058048:0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.864611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783141849.864619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521057792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141849.864670:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521057792:12345-0@lo:400:kworker.0 Request processed in 52us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141849.864676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:3.0:1783141849.864852:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6df800 x1869759521057792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141849.864863:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521057792:0@lo:400:kworker.0 00000100:00080000:1.0:1783141849.864905:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783141849.990703:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141850.372681:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141850.372701:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521058432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141850.372768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141850.372849:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058432 00000100:00100000:3.0:1783141850.372856:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058432 00000100:00100000:3.0:1783141850.372898:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783141850.372907:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521058432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141850.372938:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141850.372982:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521058432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141850.372989:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783141850.373046:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521058432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141850.884492:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141850.884514:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521058560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141850.884581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141850.884645:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058560 00000100:00100000:3.0:1783141850.884652:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058560 00000100:00100000:3.0:1783141850.884696:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783141850.884705:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521058560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141850.893561:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141850.893710:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521058560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9002us (9125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141850.893722:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1783141850.898193:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43286300 x1869759521058560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141850.898220:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521058560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141851.017240:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783141851.022789:0:13042:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783141851.397434:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521058688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141851.397505:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141851.397740:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058688 00000100:00100000:3.0:1783141851.397748:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058688 00000100:00080000:1.0:1783141851.397864:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141851.397995:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783141851.398006:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521058688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141851.398029:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141851.398096:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521058688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141851.398104:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1783141851.398243:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bea00 x1869759521058688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141851.398262:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521058688:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783141852.036510:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141853.064467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141854.085423:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141854.164762:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce43b39d0 20000000:00000080:1.0:1783141854.164778:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9b4354b000 uarg=0000000000000000 20000000:01000000:1.0:1783141854.164821:0:13189:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783141854.164826:0:13189:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783141854.164830:0:13189:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783141854.166660:0:13190:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1783141854.166806:0:13189:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783141854.174524:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783141854.175127:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175150:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175176:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175183:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175190:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175210:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175217:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175224:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175266:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175301:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 12 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.175316:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521058816:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141854.175427:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175435:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.175444:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521058944:0@lo:104: 00000100:00100000:0.0:1783141854.175480:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.175518:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521058944 00000100:00100000:0.0:1783141854.175526:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521058944 00000100:00100000:0.0:1783141854.175582:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141854.175593:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521058944:12345-0@lo:104: 00010000:00010000:0.0:1783141854.175614:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175706:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141854.175722:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521058944:12345-0@lo:104: Request processed in 122us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.175730:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1783141854.175791:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175800:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.175809:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059072:0@lo:104: 00000100:00100000:0.0:1783141854.175844:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.175876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059072 00000100:00100000:0.0:1783141854.175894:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059072 00000100:00100000:0.0:1783141854.175912:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141854.175918:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059072:12345-0@lo:104: 00010000:00010000:0.0:1783141854.175940:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.175986:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141854.176004:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059072:12345-0@lo:104: Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.176011:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1783141854.176052:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.176087:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 23 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.176107:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059200:0@lo:104: 00000100:00100000:0.0:1783141854.176147:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.176179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059200 00000100:00100000:0.0:1783141854.176183:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059200 00000100:00100000:0.0:1783141854.176212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783141854.176218:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059200:12345-0@lo:104: 00010000:00010000:0.0:1783141854.176239:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.176313:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783141854.176319:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059200:12345-0@lo:104: Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.176325:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1783141854.176390:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.176399:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.176407:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059328:0@lo:104: 00000100:00100000:0.0:1783141854.176442:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.176472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059328 00000100:00100000:0.0:1783141854.176475:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059328 00000100:00100000:0.0:1783141854.176507:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783141854.176513:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059328:12345-0@lo:104: 00010000:00010000:0.0:1783141854.176541:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.176581:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783141854.176587:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13189:x1869759521059328:12345-0@lo:104: Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.176605:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1783141854.176645:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.176669:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.176679:0:13189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059456:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141854.176737:0:13189:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141854.176769:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521058944:0@lo:104: 00000100:00100000:0.0:1783141854.176779:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059072:0@lo:104: 00000100:00100000:0.0:1783141854.176786:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059200:0@lo:104: 00000100:00100000:0.0:1783141854.176810:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059328:0@lo:104: 00010000:00010000:2.0:1783141854.176943:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783141854.176949:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.176957:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141854.176961:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.176983:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141854.176991:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141854.177006:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141854.177054:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177062:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141854.177092:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177100:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9b424cc000/0xb31399d6a3806e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ea5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177127:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783141854.177131:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177160:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2200 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141854.177164:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177171:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141854.177188:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141854.177193:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141854.177221:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177227:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141854.177247:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177254:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3806e90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177264:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141854.177267:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177319:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2800 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141854.177322:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177351:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141854.177383:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141854.177388:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141854.177403:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177408:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141854.177424:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177431:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3806e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177440:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141854.177443:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177449:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141854.177452:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177458:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141854.177464:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141854.177474:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141854.177488:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177493:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141854.177500:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177507:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76345400/0xb31399d6a3806e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806e7b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177518:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141854.177520:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141854.177522:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141854.177533:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521059840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.177566:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.177601:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141854.177610:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521059968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.177630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.177658:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059840 00000100:00100000:2.0:1783141854.177662:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059840 00010000:00010000:2.0:1783141854.177681:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 24 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.177700:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059968 00000100:00100000:2.0:1783141854.177703:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059968 00010000:00010000:2.0:1783141854.177712:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 25 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.177740:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141854.177746:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3652:x1869759521059840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.177757:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.177762:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 25 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177772:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 25 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177783:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cde00/0xb31399d6a3806e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806e82 expref: 25 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177793:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.177820:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521059840:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.177827:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141854.177840:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141854.177846:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3652:x1869759521059968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.177852:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.177856:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177864:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177873:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cc600/0xb31399d6a3806e7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806e74 expref: 23 pid: 6515 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.177890:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.177910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3652:x1869759521059968:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.177915:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141854.177945:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521059968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.177951:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521059840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.177978:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521059584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.177998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.178013:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141854.178018:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521059712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.178034:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.178050:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059584 00000100:00100000:2.0:1783141854.178053:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059584 00010000:00010000:2.0:1783141854.178065:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.178080:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521059712 00000100:00100000:2.0:1783141854.178083:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521059712 00010000:00010000:2.0:1783141854.178092:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.178104:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141854.178108:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3654:x1869759521059584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.178115:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.178118:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178136:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178146:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76345200/0xb31399d6a3806ea5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806e9e expref: 23 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178153:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.178177:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3654:x1869759521059584:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.178182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141854.178193:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141854.178197:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3654:x1869759521059712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.178204:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.178207:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178214:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178222:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2c00/0xb31399d6a3806e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806e90 expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.178228:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.178244:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759521059712:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.178249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141854.178289:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521059712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141854.178297:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521059584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141854.181701:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141854.185380:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521058816:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141854.185570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141854.185634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059200 00000100:00100000:2.0:1783141854.185642:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059200 00010000:00010000:2.0:1783141854.185678:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.185719:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:2.0:1783141854.185729:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501059200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.185743:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.185748:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.185759:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.185777:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cd200/0xb31399d6a3806eba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e571 expref: 13 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.185790:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.185853:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2403:x1869759501059200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.185860:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:0.0:1783141854.192697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141854.192807:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059328 00000100:00100000:2.0:1783141854.192826:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059328 00010000:00010000:2.0:1783141854.192876:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.192945:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1783141854.192964:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2403:x1869759501059328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.193019:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.193027:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193040:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 12 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193090:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193099:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193127:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193135:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193153:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193160:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.193167:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141854.194570:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.194590:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.194620:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.194633:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.194705:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2403:x1869759501059328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1738us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.194715:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00010000:00010000:1.0:1783141854.195985:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cdc00/0xb31399d6a3806e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e532 expref: 11 pid: 6516 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.196017:0:13189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1869759521059456:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141854.196097:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.196108:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.196128:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.196135:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40031a00/0xb31399d6a3806edd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.467811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141854.467854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141854.467888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141854.467931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141854.467957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141854.468023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059456 00000100:00100000:2.0:1783141854.468032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059456 00000100:00100000:2.0:1783141854.468096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 309 00000100:00100000:2.0:1783141854.468106:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2402:x1869759501059456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141854.468173:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2402:x1869759501059456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.468180:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 309 00000100:00100000:0.0:1783141854.470761:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059712 00000100:00100000:0.0:1783141854.470774:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059712 00000100:00100000:0.0:1783141854.470849:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059968 00000100:00100000:0.0:1783141854.470852:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059968 00000100:00100000:0.0:1783141854.470872:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059584 00000100:00100000:0.0:1783141854.470874:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059584 00000100:00100000:0.0:1783141854.470895:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:0.0:1783141854.470918:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501059712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141854.470986:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501059712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.470993:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:0.0:1783141854.471012:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:0.0:1783141854.471019:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501059968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141854.471041:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501059968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.471047:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:0.0:1783141854.471060:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:0.0:1783141854.471066:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501059584:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141854.471522:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501059840 00000100:00100000:1.0:1783141854.471529:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501059840 00000100:00100000:1.0:1783141854.471565:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:1.0:1783141854.471573:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501059840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141854.471666:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501059584:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 598us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.471674:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:1.0:1783141854.471701:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501059840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 126us (3740us total) trans 0 rc 0/0 00000100:00080000:0.0:1783141854.471706:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141854.471711:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141854.471773:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141854.471790:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521060096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141854.471836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141854.472336:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:1.0:1783141854.472655:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060096 00000100:00100000:1.0:1783141854.472661:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060096 00000100:00100000:1.0:1783141854.472693:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783141854.472701:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521060096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141854.472987:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141854.473055:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521060096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 354us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141854.473062:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783141854.473208:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521060096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141854.980742:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141854.980772:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521060224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141854.980840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.980902:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060224 00000100:00100000:2.0:1783141854.980909:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060224 00000100:00100000:2.0:1783141854.980961:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783141854.980970:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521060224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141854.980996:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141854.981062:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521060224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.981070:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1783141854.981112:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc0380 x1869759521060224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141854.981139:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521060224:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783141854.981368:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141854.981749:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521060352:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.981796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.981826:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521060864:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.981851:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.981870:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521061376:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.981892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.981910:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783141854.981915:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521060480:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.981938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.981953:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521060992:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.981973:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.981987:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521061504:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060352 00000100:00100000:2.0:1783141854.982033:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060352 00000100:00100000:2.0:1783141854.982183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1783141854.982192:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3652:x1869759521060352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982234:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3652:x1869759521060352:12345-0@lo:400:kworker.0 Request processed in 44us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.982242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1783141854.982290:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521060608:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982360:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521061120:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982383:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982401:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521061632:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982441:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783141854.982447:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521060736:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982468:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982478:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521061248:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982512:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521061760:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982531:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141854.982553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060480 00000100:00100000:2.0:1783141854.982556:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060480 00000100:00100000:2.0:1783141854.982576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060992 00000100:00100000:2.0:1783141854.982578:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060992 00000100:00100000:2.0:1783141854.982596:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061504 00000100:00100000:2.0:1783141854.982598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061504 00000100:00100000:2.0:1783141854.982608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061120 00000100:00100000:2.0:1783141854.982610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061120 00000100:00100000:2.0:1783141854.982622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061632 00000100:00100000:2.0:1783141854.982624:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061632 00000100:00100000:2.0:1783141854.982635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060736 00000100:00100000:2.0:1783141854.982637:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060736 00000100:00100000:2.0:1783141854.982649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783141854.982654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521060480:12345-0@lo:400:kworker.0 Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.982695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783141854.982715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783141854.982721:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521060992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.982748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521060992:12345-0@lo:400:kworker.0 Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.982753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783141854.982810:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060864 00000100:00100000:3.0:1783141854.982814:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060864 00000100:00100000:3.0:1783141854.982841:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521060608 00000100:00100000:3.0:1783141854.982844:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521060608 00000100:00100000:3.0:1783141854.982861:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783141854.982869:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521060864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.982940:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061376 00000100:00100000:0.0:1783141854.982944:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061376 00000100:00100000:0.0:1783141854.982973:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061248 00000100:00100000:0.0:1783141854.982976:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061248 00000100:00100000:0.0:1783141854.982989:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061760 00000100:00100000:0.0:1783141854.982990:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061760 00000100:00100000:0.0:1783141854.983003:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141854.983008:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521061376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.983043:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521061376:12345-0@lo:400:kworker.0 Request processed in 34us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.983066:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141854.983079:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783141854.983085:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521061248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.983122:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521061248:12345-0@lo:400:kworker.0 Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.983127:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783141854.983138:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141854.983144:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521061760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.983172:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521061760:12345-0@lo:400:kworker.0 Request processed in 28us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.983178:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141854.983206:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783141854.983215:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141854.983226:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521060864:12345-0@lo:400:kworker.0 Request processed in 357us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.983243:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783141854.983249:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521061504:12345-0@lo:400:kworker.0 Request processed in 35us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.983257:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783141854.983262:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783141854.983293:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521060608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.983301:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783141854.983310:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521061120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.983442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783141854.983450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521061632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.984310:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521061120:12345-0@lo:400:kworker.0 Request processed in 999us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.984320:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783141854.984343:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783141854.984363:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521060736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141854.984402:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521060736:12345-0@lo:400:kworker.0 Request processed in 52us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.984414:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1783141854.984456:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141854.984460:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141854.984463:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141854.984465:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141854.984508:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521060736:0@lo:400:kworker.0 00010000:00080000:0.0:1783141854.984522:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc2680 x1869759521061248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141854.984533:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521061248:0@lo:400:kworker.0 00010000:00080000:0.0:1783141854.984544:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762adf80 x1869759521061760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141854.984552:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521061760:0@lo:400:kworker.0 00010000:00080000:0.0:1783141854.984561:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc2d80 x1869759521061120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141854.984569:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521061120:0@lo:400:kworker.0 00000100:00100000:1.0:1783141854.984968:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141854.984984:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521061888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141854.985204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141854.985243:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521061888 00000100:00100000:1.0:1783141854.985317:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521061888 00000100:00100000:1.0:1783141854.985365:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783141854.985372:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521061888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141854.985389:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141854.985425:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521061888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141854.985432:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783141854.985585:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521060608:12345-0@lo:400:kworker.0 Request processed in 2313us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.985587:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521061632:12345-0@lo:400:kworker.0 Request processed in 2135us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.985597:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783141854.985636:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521060480:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.985648:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521060992:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.985660:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521061504:0@lo:400:kworker.0 00000100:00100000:3.0:1783141854.985665:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783141854.985676:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521060352:0@lo:400:kworker.0 00000100:00100000:2.0:1783141854.985691:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521060864:0@lo:400:kworker.0 00010000:00080000:2.0:1783141854.985704:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc3800 x1869759521061376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141854.985713:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521061376:0@lo:400:kworker.0 00010000:00080000:1.0:1783141854.985996:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43285500 x1869759521061888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141854.986011:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521061888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141854.986306:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521060608:0@lo:400:kworker.0 00010000:00080000:3.0:1783141854.986323:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762afb80 x1869759521061632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141854.986334:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521061632:0@lo:400:kworker.0 00000001:00100000:1.0:1783141854.988521:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000020:00000080:1.0:1783141854.988530:0:9517:0:(genops.c:906:class_export_put()) final put ffff9f9b42583000/37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00100000:2.0:1783141854.988633:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000020:00000080:2.0:1783141854.988638:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9b43028000/37e420ea-50f1-4924-a953-18d6b00f4d34 00000020:00000080:0.0:1783141854.988790:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b42583000/37e420ea-50f1-4924-a953-18d6b00f4d34 for lustre-OST0001 00000020:00000080:0.0:1783141854.991169:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b43028000/37e420ea-50f1-4924-a953-18d6b00f4d34 for lustre-OST0000 00000020:00000080:0.0:1783141854.991764:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b42586000 for lustre-OST0001 00000020:00000080:0.0:1783141854.991774:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4302a000 for lustre-OST0000 00010000:00010000:2.0:1783141855.109822:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141855.494607:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141855.494628:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521062016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141855.494695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141855.494793:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062016 00000100:00100000:1.0:1783141855.494800:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062016 00000100:00100000:1.0:1783141855.494845:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783141855.494852:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521062016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141855.494883:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783141855.494925:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521062016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141855.494931:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783141855.494966:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521062016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141855.618076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141855.618167:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060096 00000100:00100000:2.0:1783141855.618177:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060096 00000100:00100000:2.0:1783141855.618715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 311 00000100:00100000:2.0:1783141855.618848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:6171:x1869759501060096:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141855.618864:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.618884:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5a2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.619015:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.619027:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.619035:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:2.0:1783141855.619091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060096:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 368us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.619100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 311 00000100:00100000:2.0:1783141855.622631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141855.622740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060224 00000100:00100000:0.0:1783141855.622750:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060224 00000100:00100000:0.0:1783141855.622804:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 312 00000100:00100000:0.0:1783141855.622813:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060224:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141855.622969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060224:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141855.622977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 312 00000100:00100000:1.0:1783141855.632130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141855.632910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060352 00000100:00100000:2.0:1783141855.632920:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060352 00000100:00100000:2.0:1783141855.632976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 313 00000100:00100000:2.0:1783141855.632985:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060352:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141855.633185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060352:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 200us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.633194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 313 00000100:00100000:1.0:1783141855.640598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141855.641121:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060480 00000100:00100000:0.0:1783141855.641132:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060480 00000100:00100000:0.0:1783141855.641247:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 314 00000100:00100000:0.0:1783141855.641258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501060480:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141855.641298:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141855.641314:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.641359:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.641370:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.641379:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40030a00, rc 0) 00000100:00100000:0.0:1783141855.641437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501060480:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 181us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141855.641445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 314 00000100:00100000:1.0:1783141855.645595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141855.645676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060608 00000100:00100000:3.0:1783141855.645686:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060608 00000100:00100000:3.0:1783141855.645736:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 315 00000100:00100000:3.0:1783141855.645745:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501060608:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141855.645890:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501060608:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 145us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141855.645898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 315 00000100:00100000:3.0:1783141855.648612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141855.648706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060736 00000100:00100000:0.0:1783141855.648715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060736 00000100:00100000:0.0:1783141855.648812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 316 00000100:00100000:0.0:1783141855.648822:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501060736:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141855.648952:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501060736:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 130us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141855.648967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 316 00000100:00100000:0.0:1783141856.004416:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521062144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141856.004492:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.004587:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062144 00000100:00100000:0.0:1783141856.004595:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062144 00000100:00100000:0.0:1783141856.004655:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783141856.004666:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521062144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141856.004694:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141856.004743:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521062144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.004750:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783141856.004771:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141856.004808:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dea00 x1869759521062144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141856.004827:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521062144:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1783141856.068494:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141856.068501:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f70d800 from 7 10000000:01000000:0.0:1783141856.068504:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141856.068546:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.068557:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.068567:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.068603:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.068665:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.068719:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c411ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141856.068768:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062272 00000100:00100000:2.0:1783141856.068775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062272 00000100:00100000:2.0:1783141856.068832:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1783141856.068840:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521062272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141856.068853:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141856.068864:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806ef2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.068883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.068892:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.068900:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3800, rc 0) 00000100:00100000:2.0:1783141856.068941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.068947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783141856.069111:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141856.069130:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.069139:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.069199:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.069225:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.069251:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c411ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141856.069473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062400 00000100:00100000:2.0:1783141856.069478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062400 00000100:00100000:2.0:1783141856.069502:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1783141856.069508:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141856.069598:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.069604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1783141856.069632:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141856.069658:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141856.069696:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141856.069715:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.069864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062528 00000100:00100000:0.0:1783141856.069868:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062528 00000100:00100000:0.0:1783141856.069896:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783141856.069903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.069974:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.069981:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1783141856.070063:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783141856.076736:0:13290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783141856.076819:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783141856.076846:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141856.076859:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.076885:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141856.076895:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141856.076898:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b728800 from 7 10000000:01000000:0.0:1783141856.076901:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141856.076935:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.076942:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.076952:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.076978:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.077048:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.077089:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e5eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.077110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062656 00000100:00100000:0.0:1783141856.077116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062656 00000100:00100000:0.0:1783141856.077156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783141856.077165:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521062656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141856.077178:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141856.077189:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806f00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.077210:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.077231:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.077240:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40031e00, rc 0) 00000100:00100000:0.0:1783141856.077296:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521062656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.077303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783141856.077511:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141856.077526:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.077535:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.077585:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.077611:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.077626:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526add80 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.079102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062784 00000100:00100000:0.0:1783141856.079113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062784 00000100:00100000:0.0:1783141856.079160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783141856.079168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521062784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.079318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521062784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.079326:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783141856.079394:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.079460:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.079501:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.079530:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526add80 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.079545:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521062912 00000100:00100000:0.0:1783141856.079548:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521062912 00000100:00100000:0.0:1783141856.079569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783141856.079576:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521062912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.079649:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521062912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.079656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783141856.079695:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521062912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783141856.080755:0:13293:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783141856.080867:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783141856.080886:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141856.080895:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.080906:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141856.080917:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141856.080919:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b4fc000 from 7 10000000:01000000:0.0:1783141856.080922:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141856.080947:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.080955:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.080978:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.080995:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081036:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.081065:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.081081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063040 00000100:00100000:0.0:1783141856.081085:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063040 00000100:00100000:0.0:1783141856.081113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783141856.081119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521063040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141856.081129:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141856.081139:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806f0e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.081157:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.081167:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.081175:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c40031400, rc 0) 00000100:00100000:0.0:1783141856.081200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.081206:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783141856.081238:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141856.081251:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.081265:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.081327:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081361:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.081372:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46340c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.081392:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063168 00000100:00100000:0.0:1783141856.081396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063168 00000100:00100000:0.0:1783141856.081414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783141856.081419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081495:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.081501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783141856.081525:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081545:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081576:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.081586:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46340c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.081596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063296 00000100:00100000:0.0:1783141856.081598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063296 00000100:00100000:0.0:1783141856.081614:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783141856.081619:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.081675:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.081682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783141856.081716:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783141856.087667:0:13294:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783141856.088494:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783141856.088526:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141856.088644:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.088657:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141856.088668:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141856.088671:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c4bd6c000 from 7 10000000:01000000:0.0:1783141856.088674:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141856.088734:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.088742:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.088754:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.088778:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.088964:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141856.089018:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49ac4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141856.089295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063424 00000100:00100000:2.0:1783141856.089303:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063424 00000100:00100000:2.0:1783141856.089359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783141856.089370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521063424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141856.089447:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141856.089460:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3806f1c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.089483:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.089493:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.089500:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2800, rc 0) 00000100:00100000:2.0:1783141856.089554:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521063424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.089561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783141856.089920:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141856.089937:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.089948:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.090010:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141856.090042:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141856.090073:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.090708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063552 00000100:00100000:0.0:1783141856.090716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063552 00000100:00100000:0.0:1783141856.090747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783141856.090753:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521063552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.090944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521063552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.090964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783141856.091018:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141856.091061:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141856.091106:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141856.091140:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c762efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.091267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063680 00000100:00100000:0.0:1783141856.091332:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063680 00000100:00100000:0.0:1783141856.091436:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783141856.091448:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521063680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141856.091577:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521063680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.093676:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521063680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783141856.095003:0:13295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1783141856.095240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000020:01000000:1.0:1783141856.095669:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783141856.095691:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141856.095702:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.095712:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.133368:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141856.518752:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141856.518775:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521063808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141856.518843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141856.518926:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063808 00000100:00100000:1.0:1783141856.518934:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063808 00000100:00100000:1.0:1783141856.518990:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783141856.518999:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521063808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141856.519021:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141856.519062:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521063808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141856.519069:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1783141856.519089:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783141856.519119:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bf100 x1869759521063808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141856.519137:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521063808:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141857.156484:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141857.523949:0:13389:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141858.182666:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141859.210651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141859.590062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141859.590096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141859.590123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141859.590147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141859.590170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141859.590218:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061120 00000100:00100000:3.0:1783141859.590227:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061120 00000100:00100000:3.0:1783141859.590305:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061376 00000100:00100000:3.0:1783141859.590308:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061376 00000100:00100000:3.0:1783141859.590340:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060992 00000100:00100000:3.0:1783141859.590343:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060992 00000100:00100000:3.0:1783141859.590356:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061248 00000100:00100000:3.0:1783141859.590359:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061248 00000100:00100000:3.0:1783141859.590376:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:3.0:1783141859.590385:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501061120:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141859.590555:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521063936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141859.590602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141859.590785:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501061120:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 399us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.590794:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:3.0:1783141859.590813:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:3.0:1783141859.590821:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501061376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141859.590847:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501061376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.590864:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:3.0:1783141859.590879:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783141859.590885:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501060992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141859.590912:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501060992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.590919:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783141859.590934:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:3.0:1783141859.592390:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501061248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141859.592465:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501061248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1524us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.592476:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00080000:3.0:1783141859.592529:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141859.592534:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141859.592554:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521063936 00000100:00100000:3.0:1783141859.592560:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521063936 00000100:00100000:3.0:1783141859.592600:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783141859.592607:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521063936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141859.592632:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141859.592686:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521063936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.592692:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783141859.592740:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521063936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141859.594532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501060864 00000100:00100000:2.0:1783141859.594543:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501060864 00000100:00100000:2.0:1783141859.594602:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 329 00000100:00100000:2.0:1783141859.594612:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501060864:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141859.594681:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501060864:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (4629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141859.594688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 329 00000100:00100000:0.0:1783141860.100690:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521064192:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.100757:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.100841:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521064704:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.100864:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.100885:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521065216:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.100904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.100930:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783141860.100935:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521064320:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.100975:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.100994:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521064832:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.101038:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521065344:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141860.101112:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064320 00000100:00100000:0.0:1783141860.101120:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064320 00000100:00100000:0.0:1783141860.101174:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141860.101184:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101236:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521064320:12345-0@lo:400:kworker.0 Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101243:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141860.101293:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521064320:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064192 00000100:00100000:0.0:1783141860.101342:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064192 00000100:00100000:0.0:1783141860.101357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064704 00000100:00100000:0.0:1783141860.101359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064704 00000100:00100000:0.0:1783141860.101374:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065216 00000100:00100000:0.0:1783141860.101375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065216 00000100:00100000:0.0:1783141860.101383:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064832 00000100:00100000:0.0:1783141860.101385:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064832 00000100:00100000:0.0:1783141860.101393:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065344 00000100:00100000:0.0:1783141860.101395:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065344 00000100:00100000:0.0:1783141860.101405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783141860.101409:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521064192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521064192:12345-0@lo:400:kworker.0 Request processed in 28us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101443:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783141860.101452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783141860.101457:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521064704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521064704:12345-0@lo:400:kworker.0 Request processed in 19us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101501:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783141860.101511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783141860.101516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521065216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101538:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521065216:12345-0@lo:400:kworker.0 Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101543:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783141860.101550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783141860.101555:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521064832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521064832:12345-0@lo:400:kworker.0 Request processed in 16us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783141860.101582:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1783141860.101586:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521065344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101602:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521065344:12345-0@lo:400:kworker.0 Request processed in 16us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.101606:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00080000:0.0:1783141860.101625:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc3480 x1869759521064832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141860.101635:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521064832:0@lo:400:kworker.0 00010000:00080000:0.0:1783141860.101643:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc3b80 x1869759521065344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141860.101651:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521065344:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101658:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521064192:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101672:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521064704:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.101679:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521065216:0@lo:400:kworker.0 00000100:00100000:1.0:1783141860.101899:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521064064:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.101930:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521064448:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.101956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.101985:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521064960:0@lo:400:kworker.0 00000100:00100000:1.0:1783141860.102002:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.102008:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.102028:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521065472:0@lo:400:kworker.0 00000100:00100000:1.0:1783141860.102028:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521064576:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.102049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141860.102049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141860.102065:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521065088:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.102084:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064448 00000100:00100000:3.0:1783141860.102089:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064448 00000100:00100000:3.0:1783141860.102111:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783141860.102117:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521064448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.102385:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064064 00000100:00100000:0.0:1783141860.102389:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064064 00000100:00100000:0.0:1783141860.102416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783141860.102421:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521064064:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783141860.102869:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141860.102876:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141860.102887:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064576 00000100:00100000:2.0:1783141860.102892:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064576 00000100:00100000:2.0:1783141860.102920:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783141860.103009:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521064576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.104158:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521064448:12345-0@lo:400:kworker.0 Request processed in 2035us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104169:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783141860.104245:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521064960 00000100:00100000:3.0:1783141860.104250:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521064960 00000100:00100000:3.0:1783141860.104301:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065472 00000100:00100000:3.0:1783141860.104305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065472 00000100:00100000:3.0:1783141860.104336:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141860.104343:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521064960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.104379:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521064960:12345-0@lo:400:kworker.0 Request processed in 37us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104386:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141860.104407:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783141860.104414:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521065472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.104443:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521065472:12345-0@lo:400:kworker.0 Request processed in 29us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104449:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141860.104458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.104470:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065088 00000100:00100000:3.0:1783141860.104473:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065088 00000100:00100000:1.0:1783141860.104490:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521065600:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.104503:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783141860.104508:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521065088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141860.104519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.104534:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521065088:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104539:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783141860.104547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065600 00010000:00080000:1.0:1783141860.104550:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc2300 x1869759521065088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141860.104564:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521065088:0@lo:400:kworker.0 00000100:00100000:3.0:1783141860.104565:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065600 00000100:00100000:3.0:1783141860.104580:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783141860.104586:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141860.104606:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521065856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141860.104619:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521065600:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104625:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141860.104628:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141860.104645:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141860.104652:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521065728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141860.104671:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141860.104677:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521064448:0@lo:400:kworker.0 00010000:00080000:3.0:1783141860.104690:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc3800 x1869759521064960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141860.104692:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065856 00000100:00100000:1.0:1783141860.104695:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065856 00000100:00100000:3.0:1783141860.104700:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521064960:0@lo:400:kworker.0 00010000:00080000:3.0:1783141860.104709:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc0000 x1869759521065472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141860.104717:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521065472:0@lo:400:kworker.0 00000100:00080000:3.0:1783141860.104789:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141860.104794:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141860.104812:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065728 00000100:00100000:3.0:1783141860.104823:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065728 00000100:00100000:3.0:1783141860.104842:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783141860.104848:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521065856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141860.104868:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783141860.104875:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521065728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141860.104895:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141860.104929:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521065728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (257us total) trans 0 rc 0/0 00002000:00000024:3.0:1783141860.104934:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141860.104935:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141860.104965:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521065856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141860.104971:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1783141860.105201:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b433bb800 x1869759521065728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141860.105227:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521065728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783141860.105239:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4380 x1869759521065856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141860.105249:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521065856:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1783141860.105357:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc2d80 x1869759521065600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141860.105365:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521065600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141860.106016:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521064064:12345-0@lo:400:kworker.0 Request processed in 3591us (4075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141860.106027:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783141860.106229:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521064064:0@lo:400:kworker.0 00000100:00100000:2.0:1783141860.106335:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521064576:12345-0@lo:400:kworker.0 Request processed in 3407us (4283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141860.106345:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783141860.106466:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521064576:0@lo:400:kworker.0 00010000:00010000:2.0:1783141860.229111:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141860.626269:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141860.626330:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7632ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521065984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141860.626403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141860.626433:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521065984 00000100:00100000:2.0:1783141860.626442:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521065984 00000100:00100000:2.0:1783141860.626502:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783141860.626513:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521065984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783141860.626549:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783141860.627341:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521065984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 826us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141860.627351:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783141860.640365:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7632ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521065984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141861.124852:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141861.125017:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521066112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141861.125082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141861.125209:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066112 00000100:00100000:2.0:1783141861.125217:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066112 00000100:00100000:2.0:1783141861.125269:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783141861.125348:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521066112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141861.125386:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141861.134170:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521066112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8826us (9078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141861.134186:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1783141861.134727:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7628f100 x1869759521066112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141861.134751:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521066112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141861.252457:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141861.636498:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521066240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141861.636577:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141861.636929:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066240 00000100:00100000:1.0:1783141861.636937:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066240 00000100:00100000:1.0:1783141861.636982:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141861.636990:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521066240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141861.637013:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141861.637060:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521066240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141861.637068:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1783141861.637104:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7628f100 x1869759521066240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141861.637121:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521066240:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141862.277442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783141862.814039:0:13538:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:11:01 (1783141861) === 00000100:00100000:3.0:1783141863.013045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.013081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.016303:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061632 00000100:00100000:2.0:1783141863.016327:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061632 00000100:00100000:2.0:1783141863.016389:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1783141863.016399:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:10502:x1869759501061632:12345-192.168.203.39@tcp:700:mkdir.0 00000100:00100000:2.0:1783141863.016501:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:10502:x1869759501061632:12345-192.168.203.39@tcp:700:mkdir.0 Request processed in 103us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141863.016510:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00080000:3.0:1783141863.016989:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141863.017098:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061504 00000100:00100000:0.0:1783141863.017104:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061504 00000100:00100000:0.0:1783141863.017142:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783141863.017150:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501061504:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:0.0:1783141863.017178:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141863.017246:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501061504:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 96us (4208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141863.017253:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1783141863.021211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141863.024215:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501061888 00000100:00100000:0.0:1783141863.024240:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501061888 00000100:00100000:1.0:1783141863.024367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783141863.024378:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:10502:x1869759501061888:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:1.0:1783141863.024429:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141863.024456:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e51d expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024474:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4218ba00) 00010000:00010000:1.0:1783141863.024486:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141863.024578:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024590:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024599:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024611:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024617:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.024623:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025427:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025439:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025454:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141863.025468:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015fb2b23 reply state 000000000caa1595 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025479:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025485:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:1.0:1783141863.025487:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141863.025489:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783141863.025494:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783141863.025499:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025505:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025510:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025516:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141863.025519:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025526:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025533:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4e71a300) 00010000:00010000:1.0:1783141863.025536:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141863.025545:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025551:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3806f2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141863.025679:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015fb2b23 reply state 000000000caa1595 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025690:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.025695:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9c4e71a000) 00010000:00010000:1.0:1783141863.025698:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141863.025700:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783141863.025785:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:10502:x1869759501061888:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 1406us (4581us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783141863.025795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:2.0:1783141863.042562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.042759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062016 00000100:00100000:3.0:1783141863.042768:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062016 00000100:00100000:3.0:1783141863.042825:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1783141863.042834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:10503:x1869759501062016:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:3.0:1783141863.042854:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.042879:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5b0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.042941:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.042954:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.042989:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141863.043033:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141863.043036:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141863.043069:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.043093:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b0 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.043110:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b0 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.043119:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337f00) 00010000:00010000:3.0:1783141863.043122:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141863.043125:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cca00, rc 0) 00000100:00100000:3.0:1783141863.043178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:10503:x1869759501062016:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 344us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141863.043186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1783141863.047178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.047252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062272 00000100:00100000:3.0:1783141863.047262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062272 00000100:00100000:3.0:1783141863.047345:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783141863.047354:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:10503:x1869759501062272:12345-192.168.203.39@tcp:36:chmod.0 00010000:00010000:3.0:1783141863.047404:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141863.047431:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b0 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.047469:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337f00) 00010000:00010000:3.0:1783141863.047480:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141863.047505:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.047517:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.047526:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141863.047702:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdf80c92 reply state 000000004122ebf0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.047715:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.047722:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:3.0:1783141863.047725:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783141863.047727:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783141863.047734:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783141863.047815:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:10503:x1869759501062272:12345-192.168.203.39@tcp:36:chmod.0 Request processed in 462us (647us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783141863.047823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783141863.078261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141863.078821:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062400 00000100:00100000:1.0:1783141863.078831:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062400 00000100:00100000:1.0:1783141863.078895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1783141863.078904:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:10504:x1869759501062400:12345-192.168.203.39@tcp:101:chown.0 00010000:00010000:1.0:1783141863.078929:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141863.078949:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3806f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5b7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079060:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079146:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079176:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141863.079217:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783141863.079221:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141863.079253:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3806f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b7 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079409:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b7 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.079418:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:1.0:1783141863.079421:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141863.079425:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344000, rc 0) 00000100:00100000:1.0:1783141863.079715:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:10504:x1869759501062400:12345-192.168.203.39@tcp:101:chown.0 Request processed in 811us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141863.079724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1783141863.082628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.089415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062528 00000100:00100000:3.0:1783141863.089432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062528 00000100:00100000:3.0:1783141863.089570:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:3.0:1783141863.089581:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:10504:x1869759501062528:12345-192.168.203.39@tcp:101:chown.0 00010000:00010000:3.0:1783141863.089600:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.089632:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5be expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089696:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089710:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089721:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089732:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089740:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089746:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089818:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089826:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089833:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141863.089871:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141863.089875:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141863.089895:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089911:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089917:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089924:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089930:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.089934:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089940:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089951:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:3.0:1783141863.089954:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141863.089958:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089963:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089975:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089981:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089987:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.089995:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.089998:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.090003:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.090952:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9c4e71a000) 00010000:00010000:3.0:1783141863.090958:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141863.090962:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.090969:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806f70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.091021:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5be expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.091037:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5be expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.091044:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:3.0:1783141863.091046:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141863.091049:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cce00, rc 0) 00000100:00100000:3.0:1783141863.091126:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10504:x1869759501062528:12345-192.168.203.39@tcp:101:chown.0 Request processed in 1547us (8507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141863.091134:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:2.0:1783141863.095409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141863.095514:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062656 00000100:00100000:0.0:1783141863.095523:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062656 00000100:00100000:0.0:1783141863.095579:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783141863.095591:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10504:x1869759501062656:12345-192.168.203.39@tcp:900:chown.0 00000100:00100000:0.0:1783141863.095677:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10504:x1869759501062656:12345-192.168.203.39@tcp:900:chown.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141863.095686:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783141863.098132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.098206:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501062912 00000100:00100000:3.0:1783141863.098227:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501062912 00000100:00100000:3.0:1783141863.098318:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:3.0:1783141863.098329:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10504:x1869759501062912:12345-192.168.203.39@tcp:36:chown.0 00010000:00010000:2.0:1783141863.098572:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141863.098598:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806f77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5be expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.098615:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:2.0:1783141863.098620:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141863.098651:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.098664:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.098673:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141863.105019:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1783141863.105168:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0b9bed9 reply state 000000009a2a3e98 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.105192:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.105201:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:2.0:1783141863.105367:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783141863.105373:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783141863.105386:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1783141863.105487:0:11334:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783141863.105515:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:10504:x1869759501062912:12345-192.168.203.39@tcp:36:chown.0 Request processed in 7183us (7384us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783141863.105524:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00010000:00010000:1.0:1783141863.105812:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.105823:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.105831:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.106308:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141863.106315:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.106323:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.106337:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:1.0:1783141863.106339:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783141863.106343:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141863.106350:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108409:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108426:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108433:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108439:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.108444:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108451:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108481:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9c4e71a000) 00010000:00010000:2.0:1783141863.108483:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.108487:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108494:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3806f31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108514:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108520:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108525:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108530:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.108533:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108538:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108545:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4e71ad00) 00010000:00010000:2.0:1783141863.108547:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.108550:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108556:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345800/0xb31399d6a3806f38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108580:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108586:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108592:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108597:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.108600:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.108606:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.109907:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:2.0:1783141863.109912:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783141863.109917:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.109925:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806f4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141863.119395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.119477:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063040 00000100:00100000:3.0:1783141863.119487:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063040 00000100:00100000:3.0:1783141863.119548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:3.0:1783141863.119558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:10505:x1869759501063040:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:3.0:1783141863.119583:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.119600:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5c5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783141863.122729:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2846us 00010000:00010000:2.0:1783141863.142914:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.142935:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.142946:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.142969:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.142976:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.142982:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143101:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143108:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143113:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141863.143142:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783141863.143145:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141863.143175:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143186:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143191:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143196:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143210:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.143215:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143220:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143231:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:2.0:1783141863.143234:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.143238:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143243:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143253:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143259:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143265:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143306:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.143309:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143315:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143334:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9b42688900) 00010000:00010000:2.0:1783141863.143337:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.143341:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143346:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806f93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143382:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3806f85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5c5 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143395:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5c5 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.143402:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:2.0:1783141863.143404:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783141863.143406:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3400, rc 0) 00000100:00100000:2.0:1783141863.143476:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:10505:x1869759501063040:12345-192.168.203.39@tcp:101:touch.500 Request processed in 23919us (24088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141863.143485:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783141863.146172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.146347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063296 00000100:00100000:3.0:1783141863.146356:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063296 00000100:00100000:3.0:1783141863.146411:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1783141863.146421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:10505:x1869759501063296:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:3.0:1783141863.146440:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.146458:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806fa1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5cc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146797:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146812:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146823:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146854:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146862:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.146867:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783141863.147627:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783141863.147775:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806fb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147786:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147794:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147825:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147832:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147838:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147844:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.147849:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147868:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147881:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.147884:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141863.147888:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147894:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fa8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141863.147906:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b90b3071 reply state 00000000dbce2f1d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147916:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147922:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9f9c4d337f00) 00010000:00010000:3.0:1783141863.147924:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141863.147927:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783141863.147962:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806fa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5cc expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147975:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5cc expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.147982:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9c4d337700) 00010000:00010000:3.0:1783141863.147984:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141863.147986:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cce00, rc 0) 00000100:00100000:3.0:1783141863.148224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:10505:x1869759501063296:12345-192.168.203.39@tcp:101:touch.500 Request processed in 1803us (2059us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783141863.148249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1783141863.158831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.159030:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063552 00000100:00100000:2.0:1783141863.159040:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063552 00000100:00100000:2.0:1783141863.159096:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:2.0:1783141863.159105:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:10505:x1869759501063552:12345-192.168.203.39@tcp:36:touch.500 00010000:00010000:2.0:1783141863.159158:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141863.159183:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3806fb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5cc expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.159216:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9c4d337700) 00010000:00010000:2.0:1783141863.159225:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141863.159548:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.159562:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.159572:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141863.159658:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085e54b93 reply state 000000006a5e48d6 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.159669:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.159676:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:2.0:1783141863.159679:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783141863.159681:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141863.159850:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10505:x1869759501063552:12345-192.168.203.39@tcp:36:touch.500 Request processed in 744us (1025us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783141863.159858:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783141863.170065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.170129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063680 00000100:00100000:2.0:1783141863.170138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063680 00000100:00100000:2.0:1783141863.170186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:2.0:1783141863.170195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:10505:x1869759501063680:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:2.0:1783141863.170216:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141863.170254:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806fcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.170348:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806fcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5d3 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.170362:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806fcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5d3 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.170379:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:2.0:1783141863.170382:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141863.170385:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:2.0:1783141863.170445:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:10505:x1869759501063680:12345-192.168.203.39@tcp:101:touch.500 Request processed in 251us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141863.170452:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1783141863.174549:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141863.174650:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063808 00000100:00100000:1.0:1783141863.174660:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063808 00000100:00100000:1.0:1783141863.174746:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:1.0:1783141863.174755:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1869759501063808:12345-192.168.203.39@tcp:8:touch.500 00010000:00080000:1.0:1783141863.174788:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:1.0:1783141863.174816:0:8438:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3806fd2 00002000:00100000:1.0:1783141863.174829:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 51a41658-4bb5-47ac-acec-f543eb9c9e19/ffff9f9b42582000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141863.174854:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141863.174925:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783141863.174958:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b42581800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141863.175109:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501063808:12345-192.168.203.39@tcp:8:touch.500 Request processed in 352us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141863.175128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1783141863.177801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141863.177958:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501063936 00000100:00100000:0.0:1783141863.177968:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501063936 00000100:00100000:0.0:1783141863.178114:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783141863.178125:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:0:x1869759501063936:12345-192.168.203.39@tcp:2:touch.500 00000100:00080000:3.0:1783141863.178409:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783141863.193219:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1783141863.193231:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000100:00100000:1.0:1783141863.193592:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:0:x1869759501063936:12345-192.168.203.39@tcp:2:touch.500 Request processed in 15464us (15794us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783141863.193603:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783141863.206233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141863.206420:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501064192 00000100:00100000:1.0:1783141863.206431:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501064192 00000100:00100000:1.0:1783141863.206491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1783141863.206501:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:10505:x1869759501064192:12345-192.168.203.39@tcp:35:touch.500 00000100:00100000:1.0:1783141863.207263:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:10505:x1869759501064192:12345-192.168.203.39@tcp:35:touch.500 Request processed in 760us (1036us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783141863.207390:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783141863.222984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.223087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501064320 00000100:00100000:3.0:1783141863.223097:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501064320 00000100:00100000:3.0:1783141863.223152:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783141863.223163:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:10506:x1869759501064320:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1783141863.223186:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.223204:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806fd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5da expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223267:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223330:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223341:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141863.223386:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141863.223390:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141863.223619:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223649:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806fd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5da expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223686:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5da expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.223695:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.223698:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141863.223702:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:3.0:1783141863.223835:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:10506:x1869759501064320:12345-192.168.203.39@tcp:101:rm.0 Request processed in 673us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141863.223844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783141863.232063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.233592:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501064576 00000100:00100000:2.0:1783141863.233605:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501064576 00000100:00100000:2.0:1783141863.233685:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783141863.233695:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:10506:x1869759501064576:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:2.0:1783141863.233716:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141863.234159:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3806fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5e1 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141863.234258:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783141863.234446:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3806fe7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5e1 expref: 16 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.234462:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:2.0:1783141863.234470:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141863.234476:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3806fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5e1 expref: 16 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.234497:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1e00, rc 0) 00000100:00100000:2.0:1783141863.234569:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:10506:x1869759501064576:12345-192.168.203.39@tcp:101:rm.0 Request processed in 875us (2515us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1783141863.234576:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783141863.242070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.242131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501064704 00000100:00100000:3.0:1783141863.242142:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501064704 00000100:00100000:3.0:1783141863.242202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783141863.242213:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:10506:x1869759501064704:12345-192.168.203.39@tcp:37:rm.0 00000100:00100000:3.0:1783141863.250160:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:10506:x1869759501064704:12345-192.168.203.39@tcp:37:rm.0 Request processed in 7938us (8089us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141863.250173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:0.0:1783141863.255861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141863.256140:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501064960 00000100:00100000:1.0:1783141863.256151:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501064960 00000100:00100000:1.0:1783141863.256218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1783141863.256228:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:10506:x1869759501064960:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:1.0:1783141863.256658:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:10506:x1869759501064960:12345-192.168.203.39@tcp:35:rm.0 Request processed in 430us (804us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783141863.256668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783141863.261601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.261694:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501065216 00000100:00100000:3.0:1783141863.261705:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501065216 00000100:00100000:3.0:1783141863.261826:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1783141863.261838:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:10506:x1869759501065216:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1783141863.261862:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141863.261898:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5e8 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.262022:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3806ffc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.262037:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3806ffc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.262048:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3806ffc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141863.262060:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783141863.262209:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3806ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5e8 expref: 19 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.262240:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3806ffc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5e8 expref: 18 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.262250:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.262253:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141863.262256:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cda00, rc 0) 00000100:00100000:3.0:1783141863.262381:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065216:12345-192.168.203.39@tcp:101:rm.0 Request processed in 544us (788us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783141863.262388:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1783141863.267059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.267143:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501065344 00000100:00100000:3.0:1783141863.267213:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501065344 00000100:00100000:3.0:1783141863.267418:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783141863.267429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065344:12345-192.168.203.39@tcp:41:rm.0 00000004:00000024:3.0:1783141863.267484:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1783141863.267586:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065344:12345-192.168.203.39@tcp:41:rm.0 Request processed in 159us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141863.267597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:1.0:1783141863.270423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.270555:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501065472 00000100:00100000:2.0:1783141863.270564:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501065472 00000100:00100000:2.0:1783141863.270622:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1783141863.270632:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065472:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:2.0:1783141863.270651:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141863.270671:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a380700a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5ef expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270732:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270748:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270759:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270770:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270778:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270803:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270894:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270904:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270911:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141863.270947:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783141863.270952:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141863.270971:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270983:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270991:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.270998:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271004:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271010:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.271014:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271029:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271041:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:2.0:1783141863.271044:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.271048:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271055:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271090:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271097:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271103:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271108:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141863.271111:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271117:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271125:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9f9c4d337f00) 00010000:00010000:2.0:1783141863.271128:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141863.271130:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271146:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807018 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271179:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a380700a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5ef expref: 20 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271193:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5ef expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.271201:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:2.0:1783141863.271203:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141863.271205:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1400, rc 0) 00000100:00100000:2.0:1783141863.271269:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:10506:x1869759501065472:12345-192.168.203.39@tcp:101:rm.0 Request processed in 638us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141863.271329:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:0.0:1783141863.276922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.277021:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501065728 00000100:00100000:3.0:1783141863.277032:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501065728 00000100:00100000:3.0:1783141863.277094:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783141863.277105:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:10506:x1869759501065728:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1783141863.277159:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783141863.277185:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a380701f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5ef expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277218:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3806fcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5d3 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277229:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:3.0:1783141863.277239:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3806fe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5da expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277249:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.277251:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141863.277326:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277340:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277349:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277379:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277387:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277394:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277718:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277727:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.277735:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141863.278013:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1783141863.278022:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374344749760ns, next at 375344747776ns, rc = 0 00010000:00010000:3.0:1783141863.278066:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278075:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278082:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278090:0:7934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278108:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278114:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278248:0:7934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783141863.278269:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278306:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278313:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278319:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.278323:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278330:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278339:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:3.0:1783141863.278342:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783141863.278346:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278352:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807034 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278366:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278378:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278383:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278387:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.278390:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278396:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278479:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.278483:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141863.278487:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278493:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807026 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141863.278505:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f2d8962 reply state 00000000c162b11d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278515:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.278521:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9f9c4d337f00) 00010000:00010000:3.0:1783141863.278523:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141863.278526:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141863.278601:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065728:12345-192.168.203.39@tcp:36:rm.0 Request processed in 1496us (1686us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783141863.278616:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00010000:00010000:2.0:1783141863.280043:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141863.280054:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.280064:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141863.280068:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.280076:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.280090:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:2.0:1783141863.280093:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783141863.280110:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.280116:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380703b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141863.280132:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141863.280134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141863.280136:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141863.288545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141863.288644:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501065984 00000100:00100000:2.0:1783141863.288654:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501065984 00000100:00100000:2.0:1783141863.288754:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783141863.288764:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501065984:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:2.0:1783141863.288969:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:10506:x1869759501065984:12345-192.168.203.39@tcp:35:rm.0 Request processed in 205us (432us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783141863.288977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783141863.294267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141863.294502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066240 00000100:00100000:3.0:1783141863.294513:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066240 00000100:00100000:3.0:1783141863.294578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:3.0:1783141863.294588:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:10506:x1869759501066240:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1783141863.294823:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783141863.294850:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3806ffc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5e8 expref: 19 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294873:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3806f9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5c5 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294886:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9b42688800) 00010000:00010000:3.0:1783141863.294904:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76344000/0xb31399d6a3806f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5b7 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294913:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337200) 00010000:00010000:3.0:1783141863.294919:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141863.294942:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294955:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294965:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294977:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.294999:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.295007:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.295082:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.295091:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.295098:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141863.296038:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783141863.296058:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296068:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296074:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296080:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.296084:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296091:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296116:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f9c4d337e00) 00010000:00010000:3.0:1783141863.296119:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783141863.296123:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296129:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807050 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296150:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296156:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296162:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296167:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141863.296169:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296175:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296181:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c4d337700) 00010000:00010000:3.0:1783141863.296183:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141863.296186:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296192:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807042 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141863.296215:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090fd2942 reply state 00000000871be12c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296226:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141863.296232:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9c4d337b00) 00010000:00010000:3.0:1783141863.296234:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141863.296237:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141863.296346:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:10506:x1869759501066240:12345-192.168.203.39@tcp:36:rm.0 Request processed in 1756us (2087us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783141863.296355:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00010000:00010000:3.0:1783141863.302534:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141864.324525:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141864.707315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141864.707361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141864.707389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141864.707418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141864.707445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141864.707503:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066368 00000100:00100000:2.0:1783141864.707539:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066624 00000100:00100000:2.0:1783141864.707549:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066624 00000100:00100000:2.0:1783141864.707612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066880 00000100:00100000:2.0:1783141864.707616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066880 00000100:00100000:2.0:1783141864.707635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066496 00000100:00100000:2.0:1783141864.707637:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066496 00000100:00100000:2.0:1783141864.707653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:2.0:1783141864.707663:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501066624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141864.707735:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501066624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141864.707743:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:2.0:1783141864.707762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:2.0:1783141864.707769:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501066880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141864.707803:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501066880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141864.707810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:2.0:1783141864.707822:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:2.0:1783141864.707829:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2403:x1869759501066496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141864.707855:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2403:x1869759501066496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141864.707861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00080000:2.0:1783141864.707877:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141864.707881:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141864.709331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066368 00000100:00100000:1.0:1783141864.709409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 331 00000100:00100000:1.0:1783141864.709419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501066368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141864.709483:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501066368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141864.709491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 331 00000100:00100000:0.0:1783141864.709967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141864.710064:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067008 00000100:00100000:2.0:1783141864.710069:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067008 00000100:00100000:2.0:1783141864.710169:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:2.0:1783141864.710176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501067008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141864.710224:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501067008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141864.710230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:2.0:1783141864.711626:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521066368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141864.711679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141864.711755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066368 00000100:00100000:2.0:1783141864.711760:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066368 00000100:00100000:2.0:1783141864.711797:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783141864.711807:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521066368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141864.711840:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1783141864.711856:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141864.711883:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521066368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141864.712052:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501066752 00000100:00100000:3.0:1783141864.712059:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501066752 00000100:00100000:3.0:1783141864.712102:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:3.0:1783141864.712111:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501066752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141864.712203:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783141864.712347:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521066368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141864.713124:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501066752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1010us (5674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141864.713135:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:2.0:1783141865.224391:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521066624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141865.224461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141865.224520:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141865.224526:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521066496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141865.224562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141865.224589:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066624 00000100:00100000:2.0:1783141865.224596:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066624 00000100:00100000:2.0:1783141865.224643:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066496 00000100:00100000:2.0:1783141865.224647:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066496 00000100:00100000:2.0:1783141865.224666:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141865.224674:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521066624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141865.224702:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141865.224743:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521066624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141865.224749:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783141865.224764:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783141865.224770:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521066496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141865.224779:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141865.224799:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521066496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141865.224805:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1783141865.224837:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fb800 x1869759521066496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141865.224869:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521066496:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1783141865.224882:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fbb80 x1869759521066624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141865.224891:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521066624:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783141865.225506:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141865.233380:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521067008:0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.233405:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521066880:0@lo:400:kworker.0 00000100:00100000:3.0:1783141865.233520:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521066752:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.233707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.233759:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521067520:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.233781:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.233797:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521068032:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.233814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.233829:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783141865.233834:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521067136:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.233853:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.233868:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521067648:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.233892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.233920:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067008 00000100:00100000:0.0:1783141865.233927:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067008 00000100:00100000:0.0:1783141865.233972:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141865.233980:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.234032:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521067008:12345-0@lo:400:kworker.0 Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.234039:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141865.234059:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067520 00000100:00100000:0.0:1783141865.234063:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067520 00000100:00100000:0.0:1783141865.234108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068032 00000100:00100000:0.0:1783141865.234111:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068032 00000100:00100000:0.0:1783141865.234129:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067136 00000100:00100000:0.0:1783141865.234131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067136 00000100:00100000:1.0:1783141865.236362:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141865.236415:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521067392:0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141865.236482:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521067904:0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236501:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141865.236540:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067648 00000100:00100000:1.0:1783141865.236550:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067648 00000100:00100000:1.0:1783141865.236602:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141865.236610:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236660:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521067648:12345-0@lo:400:kworker.0 Request processed in 50us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141865.236667:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1783141865.236688:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141865.236692:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141865.236700:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066880 00000100:00100000:1.0:1783141865.236703:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066880 00000100:00100000:1.0:1783141865.236718:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067392 00000100:00100000:1.0:1783141865.236721:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067392 00000100:00100000:1.0:1783141865.236738:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067904 00000100:00100000:1.0:1783141865.236741:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067904 00000100:00100000:1.0:1783141865.236758:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783141865.236765:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521067520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236805:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521067520:12345-0@lo:400:kworker.0 Request processed in 41us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.236807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783141865.236811:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783141865.236814:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521068032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236823:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783141865.236828:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521066880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.236845:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521068032:12345-0@lo:400:kworker.0 Request processed in 32us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.236851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783141865.236853:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521066880:12345-0@lo:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141865.236858:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783141865.236862:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783141865.236867:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783141865.236868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521067392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236872:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521067904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141865.236892:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521067904:12345-0@lo:400:kworker.0 Request processed in 20us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.236892:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521067392:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.236898:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783141865.236984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141865.237012:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521067264:0@lo:400:kworker.0 00000100:00100000:3.0:1783141865.237036:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141865.237052:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521067776:0@lo:400:kworker.0 00000100:00100000:3.0:1783141865.237079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141865.237155:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067776 00000100:00100000:2.0:1783141865.237160:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067776 00000100:00100000:2.0:1783141865.237186:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783141865.237192:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521067776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141865.237230:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521067776:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141865.237236:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783141865.237499:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521067264 00000100:00100000:2.0:1783141865.237503:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521067264 00000100:00100000:2.0:1783141865.237527:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783141865.237544:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521067264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141865.237575:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521067264:12345-0@lo:400:kworker.0 Request processed in 42us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141865.237582:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141865.238120:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783141865.239252:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783141865.239294:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.239366:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521067136:12345-0@lo:400:kworker.0 Request processed in 103us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.239373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783141865.239416:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521066752 00000100:00100000:0.0:1783141865.239422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521066752 00000100:00100000:0.0:1783141865.239460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783141865.239466:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521066752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.239497:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521066752:12345-0@lo:400:kworker.0 Request processed in 32us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.239503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783141865.239630:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521067136:0@lo:400:kworker.0 00010000:00080000:0.0:1783141865.239662:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43577480 x1869759521067648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141865.239674:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521067648:0@lo:400:kworker.0 00010000:00080000:0.0:1783141865.239686:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43576a00 x1869759521067520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141865.239695:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521067520:0@lo:400:kworker.0 00010000:00080000:0.0:1783141865.239707:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7631b800 x1869759521068032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141865.239716:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521068032:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.239729:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521067008:0@lo:400:kworker.0 00000100:00100000:3.0:1783141865.240159:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521066752:0@lo:400:kworker.0 00000100:00100000:3.0:1783141865.240172:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521067264:0@lo:400:kworker.0 00010000:00080000:3.0:1783141865.240184:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43577100 x1869759521067776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141865.240193:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521067776:0@lo:400:kworker.0 00000100:00080000:0.0:1783141865.243429:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141865.243439:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141865.243514:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521066880:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.243759:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521067392:0@lo:400:kworker.0 00000100:00100000:0.0:1783141865.243777:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521067904:0@lo:400:kworker.0 00010000:00010000:2.0:1783141865.361656:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141865.733321:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141865.733344:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521068160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141865.733415:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141865.733575:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068160 00000100:00100000:0.0:1783141865.733583:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068160 00000100:00100000:0.0:1783141865.733635:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783141865.733644:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521068160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141865.733676:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141865.733872:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521068160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141865.733907:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783141865.741616:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521068160:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1783141866.261106:0:8861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377327832094ns, next at 378327829524ns, rc = 0 00000100:00100000:3.0:1783141866.261128:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141866.261147:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521068288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141866.261212:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141866.261308:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068288 00000100:00100000:3.0:1783141866.261315:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068288 00000100:00100000:3.0:1783141866.261360:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141866.261369:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521068288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141866.261396:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141866.261437:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521068288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141866.261444:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1783141866.261482:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c4b3d7800 x1869759521068288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141866.261499:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521068288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783141866.373739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141866.757099:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521068416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141866.757179:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141866.757263:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068416 00000100:00100000:3.0:1783141866.757295:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068416 00000100:00100000:3.0:1783141866.757337:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783141866.757345:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521068416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141866.757369:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141866.757411:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521068416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141866.757417:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1783141866.757455:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c4b3d7800 x1869759521068416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141866.757471:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521068416:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1783141866.816012:0:13685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783141867.396840:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141867.807492:0:13733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1f48d6b0 20000000:00000080:3.0:1783141867.807519:0:13733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c76356c00 uarg=0000000000000000 20000000:01000000:3.0:1783141867.807563:0:13733:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783141867.807568:0:13733:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783141867.807573:0:13733:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783141867.808152:0:13734:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783141867.808432:0:13733:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783141867.813639:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783141867.813674:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783141867.813692:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783141867.813766:0:13733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783141867.813785:0:13733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813919:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813930:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813938:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813945:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813952:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813959:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.813967:0:13733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.814010:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.814025:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.814037:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068544:0@lo:104: 00000100:00100000:2.0:1783141867.814103:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141867.814211:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.814219:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.814228:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068672:0@lo:104: 00010000:00010000:2.0:1783141867.814253:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.816464:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.816488:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068800:0@lo:104: 00010000:00010000:2.0:1783141867.816577:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.816588:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.816596:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068928:0@lo:104: 00010000:00010000:2.0:1783141867.816625:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.816636:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 12 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.816645:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521069056:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141867.816697:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.817143:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.817153:0:13733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521069184:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141867.817191:0:13733:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c763d5840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141867.817312:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141867.817337:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.817369:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.817380:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.817389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068544 00000100:00100000:0.0:1783141867.817396:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068544 00000100:00100000:0.0:1783141867.817432:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068672 00000100:00100000:0.0:1783141867.817436:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068672 00000100:00100000:0.0:1783141867.817445:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068800 00000100:00100000:0.0:1783141867.817448:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068800 00000100:00100000:0.0:1783141867.817455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521068928 00000100:00100000:0.0:1783141867.817457:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521068928 00000100:00100000:0.0:1783141867.817469:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783141867.817477:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:13733:x1869759521068544:12345-0@lo:104: 00010000:00010000:0.0:1783141867.817489:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817541:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141867.817548:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+6:13733:x1869759521068544:12345-0@lo:104: Request processed in 72us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.817555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783141867.817595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783141867.817602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:13733:x1869759521068672:12345-0@lo:104: 00010000:00010000:0.0:1783141867.817608:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817644:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141867.817659:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+5:13733:x1869759521068672:12345-0@lo:104: Request processed in 58us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.817665:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783141867.817678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141867.817684:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:13733:x1869759521068800:12345-0@lo:104: 00010000:00010000:0.0:1783141867.817691:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817730:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783141867.817735:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+4:13733:x1869759521068800:12345-0@lo:104: Request processed in 51us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.817740:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141867.817753:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783141867.817758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13733:x1869759521068928:12345-0@lo:104: 00010000:00010000:0.0:1783141867.817766:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817792:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783141867.817796:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+3:13733:x1869759521068928:12345-0@lo:104: Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.817802:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1783141867.817936:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783141867.817943:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817950:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141867.817954:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.817974:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141867.817981:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141867.817987:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141867.818015:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818022:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141867.818041:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818049:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fa00/0xb31399d6a3806f1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818061:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141867.818065:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818070:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031200 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141867.818073:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818080:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141867.818087:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141867.818098:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141867.818111:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818117:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141867.818122:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818128:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031200/0xb31399d6a3806f0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f15 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818137:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141867.818140:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818145:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40030600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141867.818148:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818154:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141867.818160:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141867.818165:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141867.818174:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818179:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141867.818197:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818203:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40030600/0xb31399d6a3806f00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806f07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818212:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141867.818215:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141867.818223:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818229:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141867.818236:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141867.818241:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141867.818254:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818269:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141867.818295:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818301:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031a00/0xb31399d6a3806ef2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3806ef9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818313:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141867.818321:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141867.818322:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141867.818336:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521069440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.818366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.818387:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141867.818392:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521069312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.818411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.818436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069440 00000100:00100000:0.0:1783141867.818440:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069440 00010000:00010000:0.0:1783141867.818458:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 24 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141867.818475:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069312 00000100:00100000:0.0:1783141867.818478:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069312 00010000:00010000:0.0:1783141867.818488:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 25 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141867.818507:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141867.818513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3653:x1869759521069440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141867.818522:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141867.818527:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 25 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818534:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 25 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818548:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141867.818574:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3653:x1869759521069440:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.818580:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783141867.818598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141867.818604:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521069312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141867.818611:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141867.818616:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 24 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818625:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 24 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.818634:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141867.818656:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521069312:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141867.818661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141867.818695:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521069312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.818703:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521069440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141867.819225:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141867.819255:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2800/0xb31399d6a3806f23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806f1c expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.819302:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068544:0@lo:104: 00010000:00010000:2.0:1783141867.819315:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40031400/0xb31399d6a3806f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806f0e expref: 22 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.819323:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068672:0@lo:104: 00000100:00100000:2.0:1783141867.819330:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068800:0@lo:104: 00000100:00100000:2.0:1783141867.819338:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521068928:0@lo:104: 00000100:00100000:0.0:1783141867.819421:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521069568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.819453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141867.819494:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141867.819499:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521069696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.819519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141867.819969:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069568 00000100:00100000:2.0:1783141867.819976:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069568 00010000:00010000:2.0:1783141867.819998:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 22 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.820023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069696 00000100:00100000:2.0:1783141867.820025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069696 00010000:00010000:2.0:1783141867.820037:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141867.820050:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141867.820056:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3654:x1869759521069568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141867.820075:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141867.820080:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820088:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820099:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40031e00/0xb31399d6a3806f07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806f00 expref: 23 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820110:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141867.820139:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3654:x1869759521069568:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.820145:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141867.820159:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783141867.820165:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3654:x1869759521069696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141867.820172:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141867.820176:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 21 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820185:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 21 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820194:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3800/0xb31399d6a3806ef9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3806ef2 expref: 21 pid: 6517 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141867.820203:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141867.820222:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759521069696:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.820237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141867.820345:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521069696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141867.820353:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521069568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141867.823524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141867.823540:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521069056:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141867.823592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067136 00000100:00100000:3.0:1783141867.823601:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067136 00010000:00010000:3.0:1783141867.823648:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141867.823685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1783141867.823693:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501067136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141867.823718:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141867.823725:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.823750:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.823766:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40030a00/0xb31399d6a3806eeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a9 expref: 13 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.823782:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141867.823846:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2403:x1869759501067136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 152us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.823853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783141867.825460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141867.825651:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067264 00000100:00100000:3.0:1783141867.825659:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067264 00010000:00010000:3.0:1783141867.825690:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141867.825721:0:13733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1869759521069184:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141867.825739:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:3.0:1783141867.825750:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2402:x1869759501067264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141867.825762:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141867.825762:0:13733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.825768:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.825780:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829007:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2200/0xb31399d6a3806ee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5a2 expref: 12 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829031:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829057:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829078:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829085:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829092:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829099:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829105:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783141867.829110:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829118:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829136:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141867.829147:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141867.829215:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2402:x1869759501067264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3466us (3759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.829225:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00010000:00010000:0.0:1783141867.830142:0:13733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.830157:0:13733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141867.830164:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a3807057 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141868.420476:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141868.625810:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb39fba80 20000000:00000080:3.0:1783141868.625832:0:13782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c76356c00 uarg=0000000000000000 20000000:01000000:3.0:1783141868.625875:0:13782:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783141868.625881:0:13782:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783141868.625886:0:13782:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1783141868.626236:0:13783:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1783141868.626514:0:13782:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1783141868.626582:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000004:00080000:0.0:1783141868.628093:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1783141868.628169:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1783141868.628179:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1783141868.628223:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628234:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628241:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628247:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141868.628261:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628269:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628314:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9f9c4d337f00) 00010000:00010000:2.0:1783141868.628318:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141868.628322:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628328:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3806faf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628345:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628352:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628367:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628372:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141868.628375:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628382:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628390:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f9b42688900) 00010000:00010000:2.0:1783141868.628392:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141868.628395:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628400:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3806fc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628420:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628426:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628432:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628436:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cdc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141868.628439:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628454:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628463:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9f9c4d337f00) 00010000:00010000:2.0:1783141868.628465:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141868.628468:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628474:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380702d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628490:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628497:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628502:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628507:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141868.628511:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628517:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628524:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f9c4d337b00) 00010000:00010000:2.0:1783141868.628527:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141868.628530:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.628543:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807049 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141868.628878:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1783141868.628917:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1783141868.628934:0:13782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783141868.628951:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628963:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628973:0:13782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628979:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628985:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628991:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.628995:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783141868.628998:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.629005:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.629023:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.629031:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.629038:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cd600/0xb31399d6a380705e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141868.632144:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521069824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783141868.632207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141868.632525:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069824 00000100:00100000:1.0:1783141868.632533:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069824 00000100:00100000:1.0:1783141868.632587:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783141868.632595:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521069824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783141868.632619:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1783141868.632649:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a4895e7, atime: 0x6a4895e7, ctime: 0x6a4895e7, blocks: 0x0 00010000:00010000:1.0:1783141868.632657:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.632687:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1783141868.632691:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141868.632697:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783141868.632887:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783141868.632927:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.632937:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.632945:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.633056:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783141868.633194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521069824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 598us (985us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783141868.633202:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1783141868.633329:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9c7631b480/2, rc 0, transno 4294967301 00000100:00100000:3.0:1783141868.633336:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521069824:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783141868.633461:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141868.633468:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.633477:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344c00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141868.633482:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.633491:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.633508:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.633515:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6da8ae/0xb31399d6a3807065 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141868.633532:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141868.633533:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141868.633535:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783141869.188492:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141869.188499:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f70d800 from 7 10000000:01000000:1.0:1783141869.188504:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141869.188551:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.188562:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.188590:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.188613:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521069952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.188676:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.188765:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141869.188849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521069952 00000100:00100000:2.0:1783141869.188857:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521069952 00000100:00100000:2.0:1783141869.188904:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783141869.188913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:6519:x1869759521069952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141869.188925:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141869.188938:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a3807073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380706c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.188959:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a3807073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380706c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.188969:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a3807073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380706c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.188979:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1600, rc 0) 00000100:00100000:2.0:1783141869.189020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521069952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.189027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783141869.190522:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521069952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.190545:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.190556:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.190633:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.190678:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.190833:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141869.190904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070080 00000100:00100000:2.0:1783141869.190911:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070080 00000100:00100000:2.0:1783141869.190964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783141869.190972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521070080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141869.191094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521070080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.191101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1783141869.191486:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.191520:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.191569:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.191599:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141869.191652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070208 00000100:00100000:2.0:1783141869.191656:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070208 00000100:00100000:2.0:1783141869.191688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783141869.191703:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521070208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141869.191793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521070208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.191800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783141869.192076:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.192906:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13795:1869759521070336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.192966:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.193000:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141869.193064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070336 00000100:00100000:0.0:1783141869.193069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070336 00000100:00100000:0.0:1783141869.193111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1783141869.193119:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:13795:x1869759521070336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141869.193234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:13795:x1869759521070336:12345-0@lo:502:llog_process_th.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141869.193241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783141869.193504:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13795:1869759521070336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.193532:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.193542:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.193545:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.193554:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6f70d800 00000020:00000080:1.0:1783141869.193556:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783141869.193620:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.193624:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.193626:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.193629:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.193631:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.193632:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783141869.193636:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6f70d800 00000020:00000080:1.0:1783141869.193638:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141869.193670:0:13795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13795:1869759521070464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.194884:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.194931:0:13795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141869.195432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070464 00000100:00100000:0.0:1783141869.195439:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070464 00000100:00100000:0.0:1783141869.195473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783141869.195481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:13795:x1869759521070464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141869.195605:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:13795:x1869759521070464:12345-0@lo:502:llog_process_th.0 Request processed in 124us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141869.195622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783141869.195677:0:13795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13795:1869759521070464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141869.197482:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141869.197495:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141869.197498:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783141869.197504:0:13795:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783141869.207065:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783141869.207104:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141869.207116:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.207127:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141869.207138:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783141869.207140:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b728800 from 7 10000000:01000000:2.0:1783141869.207143:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141869.207179:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.207187:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.207198:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141869.207223:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141869.207327:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141869.207375:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c763d5240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.207554:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070592 00000100:00100000:1.0:1783141869.207561:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070592 00000100:00100000:1.0:1783141869.207602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783141869.207611:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:6519:x1869759521070592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.207624:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141869.207636:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76344800/0xb31399d6a3807081 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380707a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.207658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76344800/0xb31399d6a3807081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380707a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.207668:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76344800/0xb31399d6a3807081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380707a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.207689:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76344800, rc 0) 00000100:00100000:1.0:1783141869.207750:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521070592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.207756:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1783141869.207831:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141869.207845:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141869.207854:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141869.207906:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141869.207933:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141869.207962:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.208061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070720 00000100:00100000:1.0:1783141869.208066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070720 00000100:00100000:1.0:1783141869.208097:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783141869.208104:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521070720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.208219:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521070720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.208226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1783141869.208522:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141869.208552:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141869.208593:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141869.208616:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141869.208628:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070848 00000100:00100000:3.0:1783141869.208637:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070848 00000100:00100000:3.0:1783141869.208661:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1783141869.208668:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521070848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141869.208749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521070848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.208756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1783141869.208798:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521070848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.211538:0:13798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13798:1869759521070976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.211628:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.211679:0:13798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141869.211783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521070976 00000100:00100000:3.0:1783141869.211789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521070976 00000100:00100000:3.0:1783141869.211838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1783141869.211846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:13798:x1869759521070976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141869.211954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:13798:x1869759521070976:12345-0@lo:502:llog_process_th.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.211961:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783141869.213879:0:13798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13798:1869759521070976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.213923:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.213935:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.213937:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.213946:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c7b728800 00000020:00000080:1.0:1783141869.213948:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783141869.214010:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.214014:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.214015:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.214018:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.214021:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.214022:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783141869.214036:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c7b728800 00000020:00000080:1.0:1783141869.214038:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141869.214085:0:13798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13798:1869759521071104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.214144:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.214191:0:13798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141869.214882:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071104 00000100:00100000:2.0:1783141869.214890:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071104 00000100:00100000:2.0:1783141869.214936:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1783141869.214945:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:13798:x1869759521071104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141869.215077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:13798:x1869759521071104:12345-0@lo:502:llog_process_th.0 Request processed in 132us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.215084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783141869.216580:0:13798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13798:1869759521071104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141869.216628:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141869.216639:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141869.216642:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783141869.216647:0:13798:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783141869.216819:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783141869.216840:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141869.216850:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.216861:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141869.216871:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141869.216873:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c7b4fc000 from 7 10000000:01000000:1.0:1783141869.216876:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141869.216903:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.216911:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.216920:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.216937:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.216986:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.217019:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.217036:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071232 00000100:00100000:1.0:1783141869.217040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071232 00000100:00100000:1.0:1783141869.217087:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783141869.217095:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:6519:x1869759521071232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.217107:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141869.217119:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76345c00/0xb31399d6a380708f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.217139:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76345c00/0xb31399d6a380708f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807088 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.217148:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76345c00/0xb31399d6a380708f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807088 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.217169:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76345c00, rc 0) 00000100:00100000:1.0:1783141869.217204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.217210:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783141869.217244:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.217265:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.217295:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.217342:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217365:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.217377:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.217388:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071360 00000100:00100000:1.0:1783141869.217391:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071360 00000100:00100000:1.0:1783141869.217415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783141869.217420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.217508:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783141869.217532:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217552:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217584:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.217594:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.217603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071488 00000100:00100000:1.0:1783141869.217606:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071488 00000100:00100000:1.0:1783141869.217623:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783141869.217628:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.217697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783141869.217727:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.217859:0:13799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13799:1869759521071616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.217886:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.217900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071616 00000100:00100000:1.0:1783141869.217903:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071616 00000100:00100000:1.0:1783141869.217920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783141869.217925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:13799:x1869759521071616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.217980:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:13799:x1869759521071616:12345-0@lo:502:llog_process_th.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.217991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783141869.218013:0:13799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.218023:0:13799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13799:1869759521071616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.218041:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.218048:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.218050:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.218058:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c7b4fc000 00000020:00000080:1.0:1783141869.218060:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783141869.218106:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.218109:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.218110:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.218113:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.218115:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.218116:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783141869.218119:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c7b4fc000 00000020:00000080:1.0:1783141869.218121:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141869.218149:0:13799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13799:1869759521071744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.218179:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.218195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071744 00000100:00100000:1.0:1783141869.218198:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071744 00000100:00100000:1.0:1783141869.218215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783141869.218221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:13799:x1869759521071744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.218302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:13799:x1869759521071744:12345-0@lo:502:llog_process_th.0 Request processed in 80us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.218309:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783141869.218333:0:13799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.218344:0:13799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13799:1869759521071744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.218367:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.218371:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.218372:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783141869.218376:0:13799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783141869.218417:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783141869.218431:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141869.218438:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218445:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141869.218453:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141869.218455:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c4bd6c000 from 7 10000000:01000000:1.0:1783141869.218457:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141869.218472:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218480:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218488:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.218500:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.218522:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.218533:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.218543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521071872 00000100:00100000:1.0:1783141869.218546:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521071872 00000100:00100000:1.0:1783141869.218562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783141869.218584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:6519:x1869759521071872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.218591:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141869.218600:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c76345800/0xb31399d6a380709d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218616:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c76345800/0xb31399d6a380709d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807096 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218624:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c76345800/0xb31399d6a380709d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807096 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218631:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c76345800, rc 0) 00000100:00100000:1.0:1783141869.218656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521071872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.218662:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783141869.218688:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521071872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141869.218699:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141869.218707:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141869.218742:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521072000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.218762:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.218772:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.218781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072000 00000100:00100000:1.0:1783141869.218784:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072000 00000100:00100000:1.0:1783141869.218801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1783141869.218812:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521072000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.218876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521072000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.218882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1783141869.218907:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521072000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.218928:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521072128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.218957:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.218967:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.218977:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072128 00000100:00100000:1.0:1783141869.218979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072128 00000100:00100000:1.0:1783141869.218995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783141869.218999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521072128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.219054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:6519:x1869759521072128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.219060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783141869.219094:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20fff34e-7fb2-485e-92da-c3efe35c6ff5:6519:1869759521072128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.219325:0:13800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13800:1869759521072256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.219359:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.219376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072256 00000100:00100000:1.0:1783141869.219379:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072256 00000100:00100000:1.0:1783141869.219398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783141869.219403:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:13800:x1869759521072256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.219460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:13800:x1869759521072256:12345-0@lo:502:llog_process_th.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.219475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783141869.219502:0:13800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141869.219512:0:13800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13800:1869759521072256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.219529:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.219535:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.219537:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.219543:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c4bd6c000 00000020:00000080:1.0:1783141869.219545:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783141869.219576:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.219579:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.219580:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141869.219582:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141869.219584:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.219586:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783141869.219589:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c4bd6c000 00000020:00000080:1.0:1783141869.219591:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141869.219615:0:13800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13800:1869759521072384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141869.219645:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.219667:0:13800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b4254d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141869.220104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072384 00000100:00100000:2.0:1783141869.220110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072384 00000100:00100000:2.0:1783141869.220143:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1783141869.220150:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:13800:x1869759521072384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141869.220226:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:13800:x1869759521072384:12345-0@lo:502:llog_process_th.0 Request processed in 77us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.220233:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783141869.224571:0:13800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76319c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20fff34e-7fb2-485e-92da-c3efe35c6ff5:13800:1869759521072384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141869.224617:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141869.224626:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141869.224628:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783141869.224634:0:13800:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:0.0:1783141869.227293:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1783141869.228708:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783141869.228739:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141869.228750:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.228762:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141869.260684:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783141869.444440:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141869.507077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141869.507184:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067392 00000100:00100000:2.0:1783141869.507194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067392 00000100:00100000:2.0:1783141869.507260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 353 00000100:00100000:2.0:1783141869.507304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:6171:x1869759501067392:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141869.507321:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141869.507336:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a38070a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.507363:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a38070a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5f6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.507387:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a38070a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5f6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141869.507397:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0a00, rc 0) 00000100:00100000:2.0:1783141869.507452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501067392:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 184us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.507459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 353 00000100:00100000:2.0:1783141869.519029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141869.519136:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067520 00000100:00100000:1.0:1783141869.519146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067520 00000100:00100000:1.0:1783141869.519200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 354 00000100:00100000:1.0:1783141869.519225:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501067520:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.519416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501067520:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 193us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.519425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 354 00000100:00100000:3.0:1783141869.527358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141869.530045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067648 00000100:00100000:0.0:1783141869.530059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067648 00000100:00100000:0.0:1783141869.530127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 355 00000100:00100000:0.0:1783141869.530137:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501067648:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141869.530320:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501067648:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 183us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141869.530329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 355 00000100:00100000:0.0:1783141869.537178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141869.537343:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067776 00000100:00100000:2.0:1783141869.537353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067776 00000100:00100000:2.0:1783141869.537407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 356 00000100:00100000:2.0:1783141869.537416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:10791:x1869759501067776:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141869.537561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:10791:x1869759501067776:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 144us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.537570:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 356 00000100:00100000:3.0:1783141869.540980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141869.541082:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501067904 00000100:00100000:1.0:1783141869.541091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501067904 00000100:00100000:1.0:1783141869.541143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 357 00000100:00100000:1.0:1783141869.541152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:10791:x1869759501067904:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141869.541322:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:10791:x1869759501067904:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 169us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.541331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 357 00000100:00100000:3.0:1783141869.553948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141869.554264:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068032 00000100:00100000:0.0:1783141869.554311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068032 00000100:00100000:0.0:1783141869.554367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 358 00000100:00100000:0.0:1783141869.554376:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:6171:x1869759501068032:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141869.554393:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141869.554409:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407f600/0xb31399d6a38070ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e5fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141869.554436:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407f600/0xb31399d6a38070ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5fd expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141869.554464:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407f600/0xb31399d6a38070ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5fd expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141869.554473:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f600, rc 0) 00000100:00100000:0.0:1783141869.554528:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501068032:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 152us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141869.554536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 358 00000100:00100000:0.0:1783141869.560410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141869.560506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068160 00000100:00100000:2.0:1783141869.560516:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068160 00000100:00100000:2.0:1783141869.560570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 359 00000100:00100000:2.0:1783141869.560580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501068160:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141869.560731:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501068160:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.560739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 359 00000100:00100000:3.0:1783141869.564592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141869.564711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068288 00000100:00100000:1.0:1783141869.564720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068288 00000100:00100000:1.0:1783141869.564780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 360 00000100:00100000:1.0:1783141869.564790:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501068288:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141869.564943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:6171:x1869759501068288:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 154us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.564952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 360 00000100:00100000:3.0:1783141869.574066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141869.574178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068416 00000100:00100000:0.0:1783141869.574188:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068416 00000100:00100000:0.0:1783141869.574256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 361 00000100:00100000:0.0:1783141869.574266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:10794:x1869759501068416:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141869.574456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:10794:x1869759501068416:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 191us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141869.574465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 361 00000100:00100000:0.0:1783141869.581344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141869.586241:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068544 00000100:00100000:2.0:1783141869.586268:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068544 00000100:00100000:2.0:1783141869.586388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 362 00000100:00100000:2.0:1783141869.586415:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:10794:x1869759501068544:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141869.586566:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:10794:x1869759501068544:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 152us (5229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141869.586575:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 362 00000100:00100000:3.0:1783141869.825155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141869.825215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141869.825265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141869.825318:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068928 00000100:00100000:1.0:1783141869.825327:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068928 00000100:00100000:3.0:1783141869.825328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141869.825357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141869.825382:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068672 00000100:00100000:3.0:1783141869.825387:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068672 00000100:00100000:1.0:1783141869.825400:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:1.0:1783141869.825412:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141869.825423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069184 00000100:00100000:3.0:1783141869.825427:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069184 00000100:00100000:3.0:1783141869.825440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501068800 00000100:00100000:3.0:1783141869.825443:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501068800 00000100:00100000:3.0:1783141869.825456:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069056 00000100:00100000:3.0:1783141869.825458:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069056 00000100:00100000:3.0:1783141869.825472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:1.0:1783141869.825480:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.825481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141869.825506:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:3.0:1783141869.825518:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.825527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:3.0:1783141869.825545:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00080000:1.0:1783141869.825550:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141869.825551:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501069184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1783141869.825556:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141869.825560:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141869.825579:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 201 00000100:00100000:1.0:1783141869.825589:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141869.825594:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501069184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.825602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:3.0:1783141869.825614:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:3.0:1783141869.825620:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501069056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141869.825640:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501069056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141869.825645:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:1.0:1783141869.825898:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501068800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 310us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.825905:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 201 00000100:00100000:0.0:1783141869.828625:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141869.828647:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521072512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141869.828715:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141869.829054:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072512 00000100:00100000:1.0:1783141869.829063:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072512 00000100:00100000:1.0:1783141869.829115:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783141869.829124:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521072512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141869.829156:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141869.829406:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521072512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 282us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141869.829414:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783141869.829497:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521072512:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783141870.276985:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783141870.277849:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783141870.340662:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521073024:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.340732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.340790:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521073536:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.340847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.340866:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521074048:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.340885:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.340904:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783141870.340910:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521072896:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.340953:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.340972:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521073408:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.340994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.341007:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521073920:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341024:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141870.341052:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073536 00000100:00100000:0.0:1783141870.341058:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073536 00000100:00100000:0.0:1783141870.341105:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074048 00000100:00100000:0.0:1783141870.341108:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074048 00000100:00100000:0.0:1783141870.341142:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141870.341152:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521073536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341216:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521073536:12345-0@lo:400:kworker.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341223:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141870.341251:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783141870.341258:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521074048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341320:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521074048:12345-0@lo:400:kworker.0 Request processed in 62us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341326:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783141870.341345:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072896 00000100:00100000:0.0:1783141870.341349:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072896 00000100:00100000:0.0:1783141870.341379:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783141870.341386:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521072896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341420:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521072896:12345-0@lo:400:kworker.0 Request processed in 35us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341426:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783141870.341444:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073024 00000100:00100000:0.0:1783141870.341448:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073024 00000100:00100000:0.0:1783141870.341470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073408 00000100:00100000:0.0:1783141870.341473:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073408 00000100:00100000:0.0:1783141870.341488:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073920 00000100:00100000:0.0:1783141870.341490:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073920 00000100:00100000:0.0:1783141870.341505:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783141870.341510:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521073024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341541:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521073024:12345-0@lo:400:kworker.0 Request processed in 31us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341548:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783141870.341559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783141870.341566:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521073408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521073408:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783141870.341608:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783141870.341614:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521073920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341639:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521073920:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.341645:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783141870.341680:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521072896:0@lo:400:kworker.0 00010000:00080000:0.0:1783141870.341701:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f7fbb80 x1869759521073408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141870.341710:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521073408:0@lo:400:kworker.0 00010000:00080000:0.0:1783141870.341720:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6df800 x1869759521073920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141870.341727:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521073920:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341736:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521073024:0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.341745:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521073536:0@lo:400:kworker.0 00010000:00080000:0.0:1783141870.341754:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dea00 x1869759521074048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141870.341761:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521074048:0@lo:400:kworker.0 00000100:00080000:1.0:1783141870.341935:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783141870.341940:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141870.341942:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141870.342718:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521072768:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.342770:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.342830:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521073280:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.342855:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.342886:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521073792:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.342908:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141870.343021:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072768 00000100:00100000:1.0:1783141870.343028:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072768 00000100:00100000:1.0:1783141870.343057:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073280 00000100:00100000:1.0:1783141870.343059:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073280 00000100:00100000:1.0:1783141870.343082:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073792 00000100:00100000:1.0:1783141870.343084:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073792 00000100:00100000:1.0:1783141870.343096:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783141870.343103:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521072768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141870.343143:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521072768:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141870.343161:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783141870.343189:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783141870.343195:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521073280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141870.343226:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521073280:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141870.343231:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783141870.343253:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783141870.343259:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141870.343311:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521073792:12345-0@lo:400:kworker.0 Request processed in 52us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141870.343317:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1783141870.343333:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141870.343559:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521073792:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343585:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521072768:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343595:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521073280:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343609:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1783141870.343617:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521072640:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343648:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.343681:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521073152:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343704:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.343721:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521073664:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.343762:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074176:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.343782:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.343808:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073664 00000100:00100000:3.0:1783141870.343812:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073664 00000100:00100000:3.0:1783141870.343844:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074176 00000100:00100000:3.0:1783141870.343847:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074176 00000100:00100000:3.0:1783141870.343866:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783141870.343873:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521073664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141870.344502:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521073152 00000100:00100000:0.0:1783141870.344507:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521073152 00000100:00100000:0.0:1783141870.344540:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783141870.344547:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521073152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141870.344647:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783141870.344657:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521074176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.344733:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521073664:12345-0@lo:400:kworker.0 Request processed in 859us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141870.344740:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783141870.344765:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141870.344791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141870.345754:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521074432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141870.345797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141870.345833:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074304 00000100:00100000:2.0:1783141870.345839:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074304 00000100:00100000:2.0:1783141870.345866:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074432 00000100:00100000:2.0:1783141870.345868:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074432 00000100:00100000:2.0:1783141870.345881:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783141870.345887:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521074304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141870.345922:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141870.345958:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521074304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141870.345964:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783141870.345977:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783141870.345982:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521074432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141870.345990:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141870.346010:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521074432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141870.346015:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1783141870.346042:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bf480 x1869759521074432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141870.346058:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521074432:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783141870.346121:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141870.346125:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141870.346138:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521072640 00000100:00100000:2.0:1783141870.346141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521072640 00000100:00100000:2.0:1783141870.346163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1783141870.346348:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141870.346553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521072640:12345-0@lo:400:kworker.0 Request processed in 382us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141870.346560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1783141870.346799:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521073152:12345-0@lo:400:kworker.0 Request processed in 2250us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141870.346807:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783141870.347114:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521073152:0@lo:400:kworker.0 00000100:00100000:3.0:1783141870.347127:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521073664:0@lo:400:kworker.0 00000100:00100000:1.0:1783141870.347185:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521074176:12345-0@lo:400:kworker.0 Request processed in 2529us (3400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141870.347193:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1783141870.347322:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6de300 x1869759521074176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141870.347333:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074176:0@lo:400:kworker.0 00010000:00080000:3.0:1783141870.347362:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763be300 x1869759521074304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141870.347376:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141870.347385:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521072640:0@lo:400:kworker.0 00010000:00010000:2.0:1783141870.468517:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141870.854769:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521074560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141870.854840:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141870.854992:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074560 00000100:00100000:3.0:1783141870.855000:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074560 00000100:00100000:3.0:1783141870.855055:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783141870.855065:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521074560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141870.855099:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141870.855149:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521074560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141870.855156:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783141870.856618:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521074560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141871.364651:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141871.364674:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141871.364744:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141871.364976:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074688 00000100:00100000:3.0:1783141871.364992:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074688 00000100:00100000:3.0:1783141871.365060:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783141871.365071:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521074688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141871.365101:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141871.365156:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521074688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.365165:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141871.365316:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521074688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783141871.492614:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141871.877437:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521074816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141871.877506:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141871.877949:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074816 00000100:00100000:3.0:1783141871.877957:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074816 00000100:00100000:3.0:1783141871.878013:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783141871.878022:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521074816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141871.878046:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141871.878099:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521074816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.878107:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783141871.878320:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521074816:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141872.524870:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141873.543170:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783141873.933902:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1783141874.565460:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141874.945607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141874.945800:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069696 00000100:00100000:3.0:1783141874.945810:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069696 00000100:00100000:3.0:1783141874.945867:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:3.0:1783141874.945878:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141874.945951:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069568 00000100:00100000:3.0:1783141874.945953:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.945958:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069568 00000100:00100000:3.0:1783141874.945974:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:1.0:1783141874.945993:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069824 00000100:00100000:1.0:1783141874.945997:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069824 00000100:00100000:1.0:1783141874.946013:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069440 00000100:00100000:1.0:1783141874.946015:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069440 00000100:00100000:1.0:1783141874.946028:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069952 00000100:00100000:1.0:1783141874.946030:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069952 00000100:00100000:1.0:1783141874.946054:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:1.0:1783141874.946062:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069568:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141874.946106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:1.0:1783141874.946108:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069568:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.946118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501069824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141874.946119:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:1.0:1783141874.946140:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:1.0:1783141874.946149:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141874.946156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501069824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.946164:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:1.0:1783141874.946181:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501069440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.946184:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:1.0:1783141874.946196:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:3.0:1783141874.946198:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501069952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141874.946241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501069952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.946248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:3.0:1783141874.946304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501069312 00000100:00100000:3.0:1783141874.946309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501069312 00000100:00100000:3.0:1783141874.946341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 364 00000100:00100000:3.0:1783141874.946350:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501069312:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141874.946380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501069312:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.946388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 364 00000100:00080000:2.0:1783141874.946502:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141874.946507:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141874.946510:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141874.948583:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141874.948605:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521074944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141874.948679:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141874.948792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521074944 00000100:00100000:2.0:1783141874.948800:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521074944 00000100:00100000:2.0:1783141874.948841:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783141874.948849:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521074944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141874.948880:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141874.948930:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521074944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141874.948937:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783141874.949067:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521074944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141875.460616:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141875.460641:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521075456:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.460714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141875.460720:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521075328:0@lo:400:kworker.0 00000100:00100000:0.0:1783141875.460763:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.460876:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521075072:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.460918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.460945:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521075968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.460969:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.460985:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521076480:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.461020:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783141875.461269:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521075584:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.461328:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521076096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461346:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.461389:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075456 00000100:00100000:1.0:1783141875.461396:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075456 00000100:00100000:1.0:1783141875.461436:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075584 00000100:00100000:1.0:1783141875.461439:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075584 00000100:00100000:1.0:1783141875.461461:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076096 00000100:00100000:1.0:1783141875.461464:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076096 00000100:00100000:1.0:1783141875.461479:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783141875.461487:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521075456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461539:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521075456:12345-0@lo:400:kworker.0 Request processed in 52us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.461546:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783141875.461563:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783141875.461569:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521075584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461595:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521075584:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.461600:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783141875.461612:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783141875.461619:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461642:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521076096:12345-0@lo:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.461647:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783141875.461665:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075968 00000100:00100000:1.0:1783141875.461667:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075968 00000100:00100000:1.0:1783141875.461688:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076480 00000100:00100000:1.0:1783141875.461691:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076480 00000100:00100000:1.0:1783141875.461706:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141875.461711:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521075968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.461752:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521075968:12345-0@lo:400:kworker.0 Request processed in 40us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.461765:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141875.462001:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141875.462009:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.462106:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521076480:12345-0@lo:400:kworker.0 Request processed in 98us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.462112:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141875.462155:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521075584:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.462165:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521076096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.462173:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1783141875.462178:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9c7631b480, transno 4294967301 00000100:00100000:1.0:1783141875.462188:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521075968:0@lo:400:kworker.0 00010000:00080000:1.0:1783141875.462200:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6df800 x1869759521076480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141875.462219:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521076480:0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.462231:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521075456:0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463300:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521075200:0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463353:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141875.463391:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521075712:0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463416:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141875.463434:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521076224:0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463472:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141875.463510:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075200 00000100:00100000:3.0:1783141875.463517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075200 00000100:00100000:3.0:1783141875.463553:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075712 00000100:00100000:3.0:1783141875.463556:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075712 00000100:00100000:3.0:1783141875.463569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076224 00000100:00100000:3.0:1783141875.463571:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076224 00000100:00100000:3.0:1783141875.463594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783141875.463600:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521075200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463646:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521075200:12345-0@lo:400:kworker.0 Request processed in 45us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.463650:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075328 00000100:00100000:2.0:1783141875.463654:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075328 00000100:00100000:3.0:1783141875.463665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783141875.463679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783141875.463680:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783141875.463685:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521075712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141875.463705:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463713:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521075712:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.463718:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783141875.463729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783141875.463734:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141875.463738:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521075328:12345-0@lo:400:kworker.0 Request processed in 36us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.463743:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783141875.463757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521076224:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.463762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783141875.463764:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075072 00000100:00100000:2.0:1783141875.463767:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075072 00000100:00100000:2.0:1783141875.463790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783141875.463796:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141875.463798:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521075200:0@lo:400:kworker.0 00010000:00080000:3.0:1783141875.463810:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccca680 x1869759521075712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141875.463820:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521075712:0@lo:400:kworker.0 00010000:00080000:3.0:1783141875.463838:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6de300 x1869759521076224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141875.463840:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521075072:12345-0@lo:400:kworker.0 Request processed in 34us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.463847:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521076224:0@lo:400:kworker.0 00000100:00100000:2.0:1783141875.463848:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:2.0:1783141875.463875:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783141875.463880:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141875.463882:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141875.463884:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141875.463903:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521075072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141875.463914:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141875.463920:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521076608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141875.463945:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141875.465290:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521076736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141875.465340:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141875.466658:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076608 00000100:00100000:2.0:1783141875.466669:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076608 00000100:00100000:2.0:1783141875.466746:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076736 00000100:00100000:2.0:1783141875.466750:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076736 00000100:00100000:2.0:1783141875.466766:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783141875.466774:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521076608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141875.466820:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783141875.466919:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141875.466950:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783141875.466959:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521076736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141875.466971:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141875.467010:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521076736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.467017:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1783141875.467064:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a1500 x1869759521076736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141875.467090:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521076736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141875.467178:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521076608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 404us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.467185:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1783141875.467227:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b41afc380 x1869759521076608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141875.467242:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521076608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141875.468811:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521075328:0@lo:400:kworker.0 00000100:00100000:0.0:1783141875.468825:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521075840:0@lo:400:kworker.0 00000100:00100000:0.0:1783141875.468878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141875.468978:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521076352:0@lo:400:kworker.0 00000100:00100000:0.0:1783141875.469011:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.477177:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521075840 00000100:00100000:1.0:1783141875.477193:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521075840 00000100:00100000:1.0:1783141875.477306:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076352 00000100:00100000:1.0:1783141875.477309:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076352 00000100:00100000:1.0:1783141875.477336:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783141875.477347:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521075840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783141875.477361:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141875.477404:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783141875.477415:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521076352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141875.477436:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521075840:12345-0@lo:400:kworker.0 Request processed in 90us (8557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.477449:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783141875.477468:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521076352:12345-0@lo:400:kworker.0 Request processed in 55us (8454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.477476:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1783141875.478525:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6dea00 x1869759521076352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141875.478542:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521076352:0@lo:400:kworker.0 00000100:00100000:0.0:1783141875.478575:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521075840:0@lo:400:kworker.0 00010000:00010000:0.0:1783141875.590816:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141875.972593:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141875.972618:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521076864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141875.972683:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141875.974085:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076864 00000100:00100000:3.0:1783141875.974096:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076864 00000100:00100000:3.0:1783141875.974159:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783141875.974169:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521076864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783141875.974215:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783141875.974321:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521076864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.974329:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783141875.974466:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521076864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141876.484457:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141876.484482:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521076992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141876.484565:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141876.484836:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521076992 00000100:00100000:1.0:1783141876.484845:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521076992 00000100:00100000:1.0:1783141876.486451:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783141876.486468:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521076992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141876.486932:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141876.487016:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521076992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 554us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.487025:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141876.487070:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521076992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141876.612555:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141876.997943:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521077120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141876.998016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141876.998203:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077120 00000100:00100000:3.0:1783141876.998211:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077120 00000100:00100000:3.0:1783141876.998264:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783141876.998300:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521077120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141876.998323:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141876.998376:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521077120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141876.998382:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783141876.998666:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521077120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783141877.640609:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141878.660496:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141879.685313:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141880.068377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141880.068417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141880.068435:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070208 00000100:00100000:3.0:1783141880.068443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141880.068443:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070208 00000100:00100000:3.0:1783141880.068478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141880.068504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141880.068531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141880.068658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070080 00000100:00100000:2.0:1783141880.068664:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070080 00000100:00100000:2.0:1783141880.068702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 366 00000100:00100000:1.0:1783141880.068711:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521077248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141880.068714:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501070080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141880.068770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.068780:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501070080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141880.068788:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 366 00000100:00080000:2.0:1783141880.068832:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141880.068867:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070464 00000100:00100000:1.0:1783141880.068871:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070464 00000100:00100000:1.0:1783141880.068905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:1.0:1783141880.068913:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141880.068950:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141880.068958:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00080000:1.0:1783141880.068977:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141880.071618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070720 00000100:00100000:0.0:1783141880.071632:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070720 00000100:00100000:0.0:1783141880.071691:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070336 00000100:00100000:0.0:1783141880.071695:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070336 00000100:00100000:0.0:1783141880.071719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:0.0:1783141880.071727:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141880.071791:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.071799:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:0.0:1783141880.071816:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:0.0:1783141880.071822:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501070720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141880.072214:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501070720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 390us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.072220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:0.0:1783141880.072234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:0.0:1783141880.072242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141880.072269:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501070336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.072292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00080000:0.0:1783141880.072417:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141880.072478:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077248 00000100:00100000:0.0:1783141880.072482:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077248 00000100:00100000:0.0:1783141880.072511:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783141880.072529:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521077248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783141880.072563:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783141880.073781:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521077248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1249us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.073791:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783141880.073874:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521077248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141880.075436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070592 00000100:00100000:0.0:1783141880.075447:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070592 00000100:00080000:3.0:1783141880.075480:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141880.075503:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 222 00000100:00100000:0.0:1783141880.075512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501070592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141880.075589:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501070592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (7056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.075597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 222 00000040:00080000:3.0:1783141880.516935:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783141880.518716:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783141880.580694:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521077504:0@lo:400:kworker.0 00000100:00100000:1.0:1783141880.580762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.580770:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521077632:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.580812:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141880.580823:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521078016:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.580850:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521078144:0@lo:400:kworker.0 00000100:00100000:1.0:1783141880.580852:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141880.580875:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521078528:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.580888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.580911:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521078656:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.580937:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.580972:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077632 00000100:00100000:2.0:1783141880.580979:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077632 00000100:00100000:2.0:1783141880.581020:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783141880.581028:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581094:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077504 00000100:00100000:0.0:1783141880.581099:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077504 00000100:00100000:0.0:1783141880.581127:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078016 00000100:00100000:0.0:1783141880.581130:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078016 00000100:00100000:0.0:1783141880.581153:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783141880.581160:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.581206:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521077632:12345-0@lo:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.581213:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521077504:12345-0@lo:400:kworker.0 Request processed in 51us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141880.581219:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783141880.581225:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783141880.581244:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783141880.581250:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521078016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581290:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521078016:12345-0@lo:400:kworker.0 Request processed in 41us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.581320:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783141880.581344:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521077760:0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581369:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141880.581386:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078272:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.581398:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521077632:0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141880.581426:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6cccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078784:0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581445:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141880.581475:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783141880.581483:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521077376:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.581506:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078144 00000100:00100000:3.0:1783141880.581511:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078144 00000100:00100000:0.0:1783141880.581513:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.581536:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141880.581548:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078656 00000100:00100000:2.0:1783141880.581549:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521079040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141880.581552:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521077888:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.581553:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078656 00000100:00100000:3.0:1783141880.581578:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078272 00000100:00100000:3.0:1783141880.581582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078272 00000100:00100000:2.0:1783141880.581596:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141880.581597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141880.581600:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078784 00000100:00100000:3.0:1783141880.581604:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078784 00000100:00100000:3.0:1783141880.581627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783141880.581627:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521078400:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.581639:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521078144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.581639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077376 00000100:00100000:2.0:1783141880.581645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077376 00000100:00100000:0.0:1783141880.581657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.581678:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783141880.581682:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141880.581688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521077376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581711:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141880.581728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521077376:12345-0@lo:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141880.581736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783141880.581747:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521077376:0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581776:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783141880.581785:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.581793:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521078144:12345-0@lo:400:kworker.0 Request processed in 155us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.581801:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783141880.581819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141880.581824:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cb0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521078656:12345-0@lo:400:kworker.0 Request processed in 39us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.581832:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.581835:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783141880.581881:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078272:12345-0@lo:400:kworker.0 Request processed in 52us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.581888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783141880.581902:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783141880.581908:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.582027:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079040 00000100:00100000:2.0:1783141880.582032:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079040 00000100:00100000:0.0:1783141880.582064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077760 00000100:00100000:2.0:1783141880.582075:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078912 00000100:00100000:0.0:1783141880.582076:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077760 00000100:00100000:2.0:1783141880.582080:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078912 00000100:00100000:3.0:1783141880.582084:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078784:12345-0@lo:400:kworker.0 Request processed in 174us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.582092:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141880.582102:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521077888 00000100:00100000:0.0:1783141880.582107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521077888 00000100:00100000:0.0:1783141880.582122:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078400 00000100:00100000:0.0:1783141880.582124:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078400 00000100:00100000:0.0:1783141880.582137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783141880.582142:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521077760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.582185:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521077760:12345-0@lo:400:kworker.0 Request processed in 41us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.582191:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783141880.582195:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783141880.582205:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521079040:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141880.582212:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783141880.582221:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521077888:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1783141880.582231:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141880.582232:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783141880.582257:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521077888:12345-0@lo:400:kworker.0 Request processed in 37us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.582264:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783141880.582296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783141880.582302:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521078400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.582325:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141880.582333:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521078400:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141880.582337:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521079040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.582345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783141880.582350:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783141880.582392:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141880.582397:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141880.582400:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141880.582403:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:2.0:1783141880.582429:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141880.582462:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521078912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141880.582468:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1783141880.582497:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b41afc380 x1869759521079040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141880.582516:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521077888:0@lo:400:kworker.0 00000100:00100000:2.0:1783141880.582516:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521079040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141880.582539:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521078144:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.582546:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521078400:0@lo:400:kworker.0 00010000:00080000:2.0:1783141880.582556:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6ccc9180 x1869759521078656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783141880.582565:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514a80 x1869759521078912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141880.582568:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521078656:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.582589:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141880.582602:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7631b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521077760:0@lo:400:kworker.0 00000100:00100000:3.0:1783141880.582612:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078272:0@lo:400:kworker.0 00010000:00080000:3.0:1783141880.582619:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6cccaa00 x1869759521078784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141880.582629:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6cccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521078784:0@lo:400:kworker.0 00000100:00100000:1.0:1783141880.582793:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141880.582829:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521077504:0@lo:400:kworker.0 00010000:00080000:1.0:1783141880.582841:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7b6de300 x1869759521078016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141880.582850:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7b6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521078016:0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.584415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521078528 00000100:00100000:0.0:1783141880.584427:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521078528 00000100:00100000:0.0:1783141880.585211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783141880.585222:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141880.585425:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521078528:12345-0@lo:400:kworker.0 Request processed in 205us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141880.585434:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:2.0:1783141880.585449:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7628fb80 x1869759521078528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141880.585465:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521078528:0@lo:400:kworker.0 00000100:00080000:3.0:1783141880.588492:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783141880.711101:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141881.094670:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521079168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141881.094741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141881.094869:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079168 00000100:00100000:0.0:1783141881.094878:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079168 00000100:00100000:0.0:1783141881.095036:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783141881.095046:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521079168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141881.095078:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141881.095137:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521079168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141881.095145:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783141881.095226:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521079168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141881.605104:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141881.607027:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521079296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141881.607248:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141881.607863:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079296 00000100:00100000:3.0:1783141881.607872:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079296 00000100:00100000:3.0:1783141881.607964:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783141881.607974:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521079296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141881.608004:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141881.608059:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521079296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141881.608066:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783141881.608151:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521079296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783141881.732651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141882.116585:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521079424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141882.116656:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141882.116765:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079424 00000100:00100000:2.0:1783141882.116773:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079424 00000100:00100000:2.0:1783141882.116836:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1783141882.116897:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141882.116939:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521079424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141882.116974:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141882.119232:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521079424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2290us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141882.119257:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b41afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521079424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141882.123915:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:2.0:1783141882.756916:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141883.780504:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141884.804649:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141885.188737:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521079552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141885.188823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141885.189040:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079552 00000100:00100000:0.0:1783141885.189048:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079552 00000100:00100000:0.0:1783141885.189098:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783141885.189108:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521079552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783141885.189148:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783141885.189322:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521079552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.189330:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783141885.189654:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521079552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141885.189815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141885.189853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141885.191613:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071104 00000100:00100000:1.0:1783141885.191625:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071104 00000100:00100000:3.0:1783141885.191660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141885.191690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070976 00000100:00100000:1.0:1783141885.191694:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070976 00000100:00100000:1.0:1783141885.191725:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:1.0:1783141885.191735:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501071104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141885.191798:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b41afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501071104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.191806:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:1.0:1783141885.191824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 230 00000100:00100000:1.0:1783141885.191831:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501070976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141885.191857:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501070976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.191864:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 230 00000100:00080000:2.0:1783141885.191953:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141885.191958:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141885.193314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501070848 00000100:00100000:0.0:1783141885.193324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501070848 00000100:00100000:0.0:1783141885.193378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 368 00000100:00100000:0.0:1783141885.193387:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501070848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141885.193645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501070848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 258us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.193655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 368 00000100:00100000:3.0:1783141885.211025:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141885.211146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141885.211217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071360 00000100:00100000:1.0:1783141885.211227:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071360 00000100:00100000:1.0:1783141885.211327:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 231 00000100:00100000:1.0:1783141885.211336:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501071360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141885.211405:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501071360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.211412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 231 00000100:00080000:2.0:1783141885.211522:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141885.214829:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071232 00000100:00100000:0.0:1783141885.214851:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071232 00000100:00100000:0.0:1783141885.214948:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783141885.214957:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2399:x1869759501071232:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1783141885.214988:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806fd2 00000100:00080000:0.0:1783141885.214997:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b42581800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141885.215041:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1783141885.215211:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+2:2399:x1869759501071232:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 255us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.215219:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00080000:2.0:1783141885.215391:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141885.215787:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1783141885.216098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141885.218443:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071488 00000100:00100000:2.0:1783141885.218457:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071488 00000100:00100000:2.0:1783141885.219455:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:2.0:1783141885.219470:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501071488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141885.219566:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501071488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 102us (3781us total) trans 0 rc 0/0 00000100:00080000:3.0:1783141885.221801:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141885.223769:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:1.0:1783141885.700635:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141885.700714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701619:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521080192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.701658:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701696:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521080704:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.701719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701733:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141885.701759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701776:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783141885.701782:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521080064:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.701802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701815:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521080576:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.701833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701845:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081088:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.701861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.701881:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521079936:0@lo:400:kworker.0 00000100:00100000:3.0:1783141885.702024:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079680 00000100:00100000:3.0:1783141885.702032:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079680 00000100:00100000:3.0:1783141885.702077:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081216 00000100:00100000:3.0:1783141885.702080:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081216 00000100:00100000:1.0:1783141885.703015:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.703047:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521080448:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.703076:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.703285:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521080960:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.703310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141885.703339:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783141885.703342:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783141885.703345:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521079808:0@lo:400:kworker.0 00000100:00100000:3.0:1783141885.703353:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521079680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141885.703370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783141885.703382:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141885.703388:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521080320:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.703418:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141885.703426:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521079680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.703430:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521080832:0@lo:400:kworker.0 00000100:00100000:3.0:1783141885.703441:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783141885.703446:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141885.703457:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783141885.703462:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081216:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141885.703468:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080192 00000100:00100000:1.0:1783141885.703472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080192 00002000:00000024:3.0:1783141885.703473:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141885.703491:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079936 00000100:00100000:1.0:1783141885.703494:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079936 00000100:00100000:3.0:1783141885.703496:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141885.703501:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783141885.703504:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080448 00000100:00100000:1.0:1783141885.703506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080448 00000100:00100000:1.0:1783141885.703519:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080960 00000100:00080000:3.0:1783141885.703521:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141885.703521:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080960 00000100:00080000:3.0:1783141885.703524:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141885.703526:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141885.703531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080320 00000100:00100000:3.0:1783141885.703533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080832 00000100:00100000:1.0:1783141885.703533:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080320 00000100:00100000:3.0:1783141885.703535:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080832 00000100:00100000:1.0:1783141885.703552:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783141885.703563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521080192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.703595:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521080192:12345-0@lo:400:kworker.0 Request processed in 32us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.703602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783141885.703614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783141885.703620:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521079936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.703649:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521079936:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.703725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080704 00000100:00100000:0.0:1783141885.703729:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080704 00000100:00100000:0.0:1783141885.703757:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080576 00000100:00100000:0.0:1783141885.703760:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080576 00000100:00100000:0.0:1783141885.703772:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081088 00000100:00100000:0.0:1783141885.703774:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081088 00000100:00100000:0.0:1783141885.703784:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783141885.703791:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.703824:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521080704:12345-0@lo:400:kworker.0 Request processed in 33us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.703831:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783141885.703842:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783141885.703848:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.703874:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521080576:12345-0@lo:400:kworker.0 Request processed in 26us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.703879:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783141885.703889:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141885.703895:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.703945:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081088:12345-0@lo:400:kworker.0 Request processed in 50us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.703951:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141885.703969:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521080064 00000100:00100000:0.0:1783141885.703971:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521080064 00000100:00100000:0.0:1783141885.703998:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783141885.704005:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.704036:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521080064:12345-0@lo:400:kworker.0 Request processed in 32us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.704042:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783141885.704065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521079808 00000100:00100000:0.0:1783141885.704067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521079808 00000100:00100000:0.0:1783141885.704090:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1783141885.704096:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.704125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521079808:12345-0@lo:400:kworker.0 Request processed in 29us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141885.704141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783141885.707831:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783141885.707948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783141885.707990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783141885.708006:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.708709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521080960:12345-0@lo:400:kworker.0 Request processed in 708us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.708734:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783141885.708754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783141885.708764:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521080320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.708802:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521080320:12345-0@lo:400:kworker.0 Request processed in 41us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.708809:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1783141885.708834:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141885.708840:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141885.708863:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783141885.708877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521080832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.708878:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521080064:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.708900:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521080576:0@lo:400:kworker.0 00010000:00080000:1.0:1783141885.708919:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a3480 x1869759521081088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141885.708930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521080832:12345-0@lo:400:kworker.0 Request processed in 56us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141885.708935:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081088:0@lo:400:kworker.0 00000100:00100000:0.0:1783141885.708942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783141885.708958:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521079808:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.709941:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521080192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.709955:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521080704:0@lo:400:kworker.0 00010000:00080000:1.0:1783141885.709967:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43555500 x1869759521081216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141885.709985:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081216:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1783141885.710000:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c44279c00 x1869759521079680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141885.710016:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521080448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141885.710016:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141885.710562:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521080448:12345-0@lo:400:kworker.0 Request processed in 555us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141885.710570:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783141885.712891:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521080320:0@lo:400:kworker.0 00000100:00100000:3.0:1783141885.712911:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521080832:0@lo:400:kworker.0 00000100:00100000:3.0:1783141885.712922:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521079936:0@lo:400:kworker.0 00010000:00080000:3.0:1783141885.712935:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43516300 x1869759521080448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141885.712947:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521080448:0@lo:400:kworker.0 00010000:00080000:3.0:1783141885.712958:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762a0e00 x1869759521080960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141885.712966:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521080960:0@lo:400:kworker.0 00010000:00010000:2.0:1783141885.831022:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141886.213402:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521081344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141886.213487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141886.213656:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081344 00000100:00100000:1.0:1783141886.213671:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081344 00000100:00100000:1.0:1783141886.213730:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783141886.213739:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521081344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141886.213772:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783141886.214349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521081344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 609us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141886.214358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783141886.214455:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521081344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141886.727919:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141886.727942:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521081472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141886.728009:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141886.728188:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081472 00000100:00100000:0.0:1783141886.728197:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081472 00000100:00100000:0.0:1783141886.728264:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783141886.728296:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521081472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141886.728343:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141886.728399:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521081472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141886.728407:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783141886.728579:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521081472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783141886.852425:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141887.237966:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141887.237990:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141887.238061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141887.238260:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081600 00000100:00100000:3.0:1783141887.238268:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081600 00000100:00100000:3.0:1783141887.238339:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783141887.238351:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141887.238373:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141887.238435:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521081600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141887.238441:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783141887.238483:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521081600:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783141887.238644:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783141887.876509:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141888.900516:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141889.925992:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141890.308728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141890.308763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141890.308789:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071616 00000100:00100000:3.0:1783141890.308797:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071616 00000100:00100000:3.0:1783141890.308838:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 370 00000100:00100000:3.0:1783141890.308846:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501071616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141890.308901:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501071616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.308908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 370 00000100:00100000:3.0:1783141890.308936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071744 00000100:00100000:3.0:1783141890.308944:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071744 00000100:00080000:2.0:1783141890.310902:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141890.311883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:3.0:1783141890.311896:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501071744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141890.311973:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501071744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 81us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.311982:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:3.0:1783141890.312860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141890.312897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141890.312920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501071872 00000100:00100000:2.0:1783141890.312925:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072000 00000100:00100000:3.0:1783141890.312927:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501071872 00000100:00100000:2.0:1783141890.312928:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072000 00000100:00100000:3.0:1783141890.313045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:3.0:1783141890.313053:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501071872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141890.313169:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501071872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.313177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:1.0:1783141890.315182:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141890.315199:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521081728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141890.315253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.315458:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081728 00000100:00100000:1.0:1783141890.315464:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081728 00000100:00100000:1.0:1783141890.315503:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783141890.315510:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521081728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141890.315539:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141890.315579:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521081728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.315587:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783141890.315629:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521081728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141890.318296:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00100000:2.0:1783141890.318311:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501072000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141890.318381:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501072000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (5483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141890.318389:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00080000:3.0:1783141890.320288:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141890.320305:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141890.321882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141890.322005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072128 00000100:00100000:0.0:1783141890.322015:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072128 00000100:00100000:0.0:1783141890.322070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:0.0:1783141890.322079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501072128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141890.325342:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501072128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3254us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141890.325357:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00080000:3.0:1783141890.325398:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783141890.756966:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1783141890.758033:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783141890.820986:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521082240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.820986:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521081984:0@lo:400:kworker.0 00000100:00100000:0.0:1783141890.821038:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521081856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.821168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.821228:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521082496:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.821948:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.821985:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521082752:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.822033:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521083264:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.822076:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783141890.822082:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521082112:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.822147:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521082624:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822166:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.822183:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521083136:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141890.822249:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082752 00000100:00100000:3.0:1783141890.822256:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082752 00000100:00100000:3.0:1783141890.822314:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083264 00000100:00100000:3.0:1783141890.822317:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083264 00000100:00100000:3.0:1783141890.822330:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082624 00000100:00100000:3.0:1783141890.822332:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082624 00000100:00100000:3.0:1783141890.822344:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083136 00000100:00100000:3.0:1783141890.822346:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083136 00000100:00100000:3.0:1783141890.822360:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783141890.822369:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521082752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822419:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521082752:12345-0@lo:400:kworker.0 Request processed in 50us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.822425:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783141890.822443:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783141890.822449:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521083264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822476:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521083264:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.822481:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783141890.822491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783141890.822496:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521082624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822520:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521082624:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.822535:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783141890.822546:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783141890.822552:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521083136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822581:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521083136:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141890.822587:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1783141890.822611:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141890.822615:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141890.822640:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521082624:0@lo:400:kworker.0 00010000:00080000:3.0:1783141890.822651:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436be680 x1869759521083136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141890.822661:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521083136:0@lo:400:kworker.0 00000100:00100000:3.0:1783141890.822671:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521082752:0@lo:400:kworker.0 00010000:00080000:3.0:1783141890.822679:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436bd500 x1869759521083264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141890.822687:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521083264:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.822762:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.822802:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521083008:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.822836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.822879:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081984 00000100:00100000:1.0:1783141890.822882:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081984 00000100:00100000:1.0:1783141890.822911:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082240 00000100:00100000:1.0:1783141890.822914:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082240 00000100:00100000:1.0:1783141890.822944:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082496 00000100:00100000:1.0:1783141890.822947:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082496 00000100:00100000:1.0:1783141890.822967:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083008 00000100:00100000:1.0:1783141890.822970:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083008 00000100:00100000:1.0:1783141890.822985:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783141890.822991:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521081984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823027:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521081984:12345-0@lo:400:kworker.0 Request processed in 36us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.823033:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783141890.823048:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783141890.823053:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823081:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521082240:12345-0@lo:400:kworker.0 Request processed in 28us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.823086:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783141890.823111:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783141890.823117:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521082496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823144:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521082496:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.823157:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783141890.823171:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783141890.823176:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521083008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823204:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521083008:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.823210:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783141890.823232:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082112 00000100:00100000:1.0:1783141890.823235:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082112 00000100:00100000:1.0:1783141890.823267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783141890.823294:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823325:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521082112:12345-0@lo:400:kworker.0 Request processed in 32us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.823331:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1783141890.823415:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141890.823433:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521082112:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823443:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521082240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823463:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521083520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141890.823489:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783141890.823511:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4a80 x1869759521082496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141890.823532:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521082496:0@lo:400:kworker.0 00010000:00080000:1.0:1783141890.823542:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a6680 x1869759521083008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141890.823875:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521083008:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823897:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521081984:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.823912:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141890.823917:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521083392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141890.824031:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.824060:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083520 00000100:00100000:1.0:1783141890.824063:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083520 00000100:00100000:1.0:1783141890.824088:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083392 00000100:00100000:1.0:1783141890.824090:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083392 00000100:00100000:1.0:1783141890.824115:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783141890.824122:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521083520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141890.824155:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141890.824191:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521083520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.824197:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783141890.824210:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783141890.824215:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521083392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141890.824224:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141890.824247:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521083392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.824253:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1783141890.824300:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43517b80 x1869759521083392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141890.824315:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521083392:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783141890.824324:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43514380 x1869759521083520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141890.824345:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521083520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141890.825549:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141890.825790:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521082368:0@lo:400:kworker.0 00000100:00100000:0.0:1783141890.825820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141890.825844:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521082880:0@lo:400:kworker.0 00000100:00100000:0.0:1783141890.825875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141890.826577:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082368 00000100:00100000:1.0:1783141890.826584:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082368 00000100:00100000:1.0:1783141890.826633:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521082880 00000100:00100000:1.0:1783141890.826637:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521082880 00000100:00100000:1.0:1783141890.826658:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783141890.826742:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.826934:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521082368:12345-0@lo:400:kworker.0 Request processed in 195us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.827003:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783141890.827025:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783141890.827031:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521082880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.827061:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521082880:12345-0@lo:400:kworker.0 Request processed in 30us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141890.827068:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783141890.827132:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521082368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141890.827143:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521082880:0@lo:400:kworker.0 00000100:00080000:1.0:1783141890.827167:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141890.828169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521081856 00000100:00100000:2.0:1783141890.828178:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521081856 00000100:00100000:0.0:1783141890.828790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1783141890.828800:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521081856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141890.829178:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521081856:12345-0@lo:400:kworker.0 Request processed in 378us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141890.829186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1783141890.829299:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521081856:0@lo:400:kworker.0 00000001:00100000:0.0:1783141890.831797:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:0.0:1783141890.831806:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9b42582000/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:2.0:1783141890.833038:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b42582000/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-OST0000 00000020:00000080:2.0:1783141890.833106:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b42581800 for lustre-OST0000 00010000:00010000:1.0:1783141890.949001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141891.332543:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141891.332578:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521083648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141891.332651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141891.332823:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083648 00000100:00100000:0.0:1783141891.332830:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083648 00000100:00100000:0.0:1783141891.332892:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783141891.332903:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521083648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141891.332935:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141891.332989:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521083648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141891.332996:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783141891.333119:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521083648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141891.844497:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521083776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141891.844570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141891.844683:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083776 00000100:00100000:0.0:1783141891.844690:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083776 00000100:00100000:0.0:1783141891.844740:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141891.844748:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521083776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141891.844780:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141891.844833:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521083776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141891.844842:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141891.844898:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521083776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783141891.973369:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141892.356423:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141892.356455:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521083904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141892.356540:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141892.356643:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521083904 00000100:00100000:1.0:1783141892.356651:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521083904 00000100:00100000:1.0:1783141892.356703:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141892.356711:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521083904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141892.356733:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141892.356975:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521083904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 263us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141892.356983:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1783141892.357004:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141892.357209:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521083904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783141892.996873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141893.890408:0:14062:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:11:33 (1783141893) 00010000:00010000:1.0:1783141894.025379:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141895.044426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141895.429528:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521084032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141895.429657:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141895.429962:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084032 00000100:00100000:1.0:1783141895.429971:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084032 00000100:00100000:1.0:1783141895.430031:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783141895.430040:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521084032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141895.430086:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141895.430153:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521084032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141895.430160:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783141895.431075:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521084032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141895.433878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141895.433973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141895.434326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072256 00000100:00100000:2.0:1783141895.434339:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072256 00000100:00100000:3.0:1783141895.434389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141895.434451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 372 00000100:00100000:1.0:1783141895.434620:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501072256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141895.434717:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501072256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 103us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141895.444294:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 372 00000100:00100000:2.0:1783141895.445811:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072768 00000100:00100000:2.0:1783141895.445825:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072768 00000100:00100000:2.0:1783141895.445919:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:2.0:1783141895.445932:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501072768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141895.446015:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501072768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (11625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.446027:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:3.0:1783141895.446042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:2.0:1783141895.446058:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141895.446087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072384 00000100:00100000:2.0:1783141895.446092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072384 00000100:00100000:2.0:1783141895.446131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:2.0:1783141895.446139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501072384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141895.446206:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501072384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.446213:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:0.0:1783141895.446259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072512 00000100:00100000:0.0:1783141895.446284:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072512 00000100:00100000:0.0:1783141895.446360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:0.0:1783141895.446369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501072512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141895.446597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141895.446669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072640 00000100:00100000:3.0:1783141895.446673:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072640 00000100:00100000:3.0:1783141895.446703:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:3.0:1783141895.446711:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501072640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141895.446742:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501072640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141895.446750:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00080000:3.0:1783141895.446799:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141895.446803:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141895.451099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501072512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4712us (17106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.451120:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:3.0:1783141895.594864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141895.598678:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501072896 00000100:00100000:2.0:1783141895.598698:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501072896 00000100:00100000:2.0:1783141895.598804:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:2.0:1783141895.598817:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:11084:x1869759501072896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141895.598846:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141895.601402:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38070b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e604 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601493:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601507:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601519:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141895.601600:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783141895.601608:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141895.601645:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601672:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38070b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e604 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601700:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e604 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141895.601722:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:2.0:1783141895.601726:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141895.601729:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0600, rc 0) 00000100:00100000:2.0:1783141895.601810:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:11084:x1869759501072896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2995us (6953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.601819:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:1.0:1783141895.608553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141895.608890:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073024 00000100:00100000:3.0:1783141895.608904:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073024 00000100:00100000:3.0:1783141895.608982:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783141895.608994:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:11085:x1869759501073024:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141895.609023:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141895.609076:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38070c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e60b expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609176:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609194:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609209:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609227:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609234:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609441:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609532:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609542:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609548:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141895.609600:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141895.609605:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141895.609632:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609651:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609658:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609666:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609672:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cda00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141895.609676:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609684:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609698:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:3.0:1783141895.609702:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141895.609708:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609714:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38070c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609731:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609737:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609742:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609764:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cde00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141895.609767:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609772:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609779:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f9c4d337500) 00010000:00010000:3.0:1783141895.609781:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141895.609783:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609788:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38070ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609820:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38070c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e60b expref: 8 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609831:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e60b expref: 7 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141895.609838:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c4d337300) 00010000:00010000:3.0:1783141895.609841:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141895.609843:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc000, rc 0) 00000100:00100000:3.0:1783141895.609933:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11085:x1869759501073024:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 941us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141895.609943:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:0.0:1783141895.627176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141895.627728:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073152 00000100:00100000:2.0:1783141895.627743:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073152 00000100:00100000:2.0:1783141895.627822:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783141895.627832:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11085:x1869759501073152:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783141895.627927:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11085:x1869759501073152:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 Request processed in 96us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.627935:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783141895.631678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141895.631834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073408 00000100:00100000:0.0:1783141895.631855:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073408 00000100:00100000:0.0:1783141895.631917:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783141895.631926:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11085:x1869759501073408:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141895.631946:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141895.631970:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38070dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e612 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632077:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632166:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632174:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632181:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632314:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f000/0xb31399d6a38070f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632323:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f000/0xb31399d6a38070f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632330:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f000/0xb31399d6a38070f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141895.632345:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783141895.632424:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632432:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632438:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632456:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141895.632460:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632467:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632479:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c4d337300) 00010000:00010000:0.0:1783141895.632482:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141895.632487:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632493:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632505:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632510:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632525:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632530:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141895.632533:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632538:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632546:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f9c7b5c1b00) 00010000:00010000:0.0:1783141895.632548:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141895.632551:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632556:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38070ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632818:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38070dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e612 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632833:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f000/0xb31399d6a38070f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e612 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141895.632840:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:0.0:1783141895.632843:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141895.632845:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f000, rc 0) 00000100:00100000:0.0:1783141895.632912:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11085:x1869759501073408:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 984us (1241us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783141895.632928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:1.0:1783141895.642498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141895.642627:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073536 00000100:00100000:2.0:1783141895.642641:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073536 00000100:00100000:2.0:1783141895.642717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783141895.642729:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11085:x1869759501073536:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783141895.643491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11085:x1869759501073536:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 760us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.643502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783141895.645483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141895.645682:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073664 00000100:00100000:3.0:1783141895.645712:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073664 00000100:00100000:3.0:1783141895.645942:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783141895.645956:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:11085:x1869759501073664:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1783141895.673681:0:11334:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 27666us 00000100:00100000:0.0:1783141895.697166:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:11085:x1869759501073664:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 51205us (51687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.697180:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000040:00080000:0.0:1783141895.885807:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783141895.886824:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783141895.940580:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141895.940650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141895.940764:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084160 00000100:00100000:2.0:1783141895.940783:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084160 00000100:00100000:2.0:1783141895.940848:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783141895.940858:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521084160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141895.940887:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141895.940931:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521084160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141895.940938:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1783141895.941026:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783141895.941053:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765f80 x1869759521084160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141895.941080:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521084160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141895.941266:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521084288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141895.941408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941610:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521084544:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941639:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941659:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521085056:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941678:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941702:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521085568:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941722:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941747:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783141895.941752:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521084416:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941776:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941794:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521084928:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941813:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941837:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521085440:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.941871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.941900:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084544 00000100:00100000:0.0:1783141895.941905:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084544 00000100:00100000:0.0:1783141895.941935:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085056 00000100:00100000:0.0:1783141895.941939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085056 00000100:00100000:0.0:1783141895.941957:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085568 00000100:00100000:0.0:1783141895.941960:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085568 00000100:00100000:0.0:1783141895.941975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783141895.941981:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7631b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942019:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7631b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521084544:12345-0@lo:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1783141895.942040:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783141895.942046:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521085056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942086:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521085056:12345-0@lo:400:kworker.0 Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942092:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783141895.942102:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783141895.942107:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521085568:12345-0@lo:400:kworker.0 Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783141895.942158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084416 00000100:00100000:0.0:1783141895.942161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084416 00000100:00100000:0.0:1783141895.942184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1783141895.942190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521084416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521084416:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942227:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1783141895.942254:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084928 00000100:00100000:0.0:1783141895.942257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084928 00000100:00100000:0.0:1783141895.942301:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783141895.942307:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521084928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942338:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521084928:12345-0@lo:400:kworker.0 Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783141895.942361:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085440 00000100:00100000:0.0:1783141895.942365:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085440 00000100:00100000:0.0:1783141895.942388:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783141895.942394:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521085440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942421:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521085440:12345-0@lo:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942427:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1783141895.942450:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141895.942454:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141895.942464:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521084800:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.942506:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521085312:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942526:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.942543:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783141895.942549:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521084672:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942569:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.942585:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521085184:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.942626:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521085696:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942647:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141895.942671:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085312 00000100:00100000:0.0:1783141895.942674:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085312 00000100:00100000:0.0:1783141895.942702:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783141895.942708:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521085312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942739:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521085312:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942745:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783141895.942760:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084672 00000100:00100000:0.0:1783141895.942763:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084672 00000100:00100000:0.0:1783141895.942783:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783141895.942789:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942817:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521084672:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942822:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783141895.942840:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084800 00000100:00100000:0.0:1783141895.942843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084800 00000100:00100000:0.0:1783141895.942860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085184 00000100:00100000:0.0:1783141895.942863:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085184 00000100:00100000:0.0:1783141895.942873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085696 00000100:00100000:0.0:1783141895.942876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085696 00000100:00100000:0.0:1783141895.942887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783141895.942892:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521084800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942919:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521084800:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783141895.942936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783141895.942949:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.942977:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521085184:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.942982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783141895.942993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783141895.942998:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943023:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521085696:12345-0@lo:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141895.943028:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:0.0:1783141895.943044:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141895.943046:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141895.943087:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521084416:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943098:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521084928:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943108:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521085440:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943117:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521084544:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943127:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521085056:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943137:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521085568:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943171:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521084672:0@lo:400:kworker.0 00010000:00080000:0.0:1783141895.943182:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f80d880 x1869759521085184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141895.943192:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521085184:0@lo:400:kworker.0 00010000:00080000:0.0:1783141895.943203:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f80e300 x1869759521085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141895.943219:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521085696:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943231:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521084800:0@lo:400:kworker.0 00000100:00100000:0.0:1783141895.943239:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521085312:0@lo:400:kworker.0 00000100:00100000:1.0:1783141895.943337:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521084288 00000100:00100000:1.0:1783141895.943341:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521084288 00000100:00100000:1.0:1783141895.943395:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783141895.943402:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521084288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141895.943416:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141895.943460:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521084288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141895.943467:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1783141895.943493:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b436a4700 x1869759521084288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141895.943507:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521084288:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783141895.948151:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783141896.069383:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141896.458220:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141896.458241:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521085824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141896.458372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141896.458442:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085824 00000100:00100000:0.0:1783141896.458449:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085824 00000100:00100000:0.0:1783141896.458492:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783141896.458511:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521085824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141896.458543:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783141896.458597:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521085824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141896.458604:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783141896.458645:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521085824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141896.966962:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141896.966984:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521085952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141896.967110:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141896.967180:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521085952 00000100:00100000:1.0:1783141896.967188:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521085952 00000100:00100000:1.0:1783141896.967245:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783141896.967255:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521085952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141896.967302:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141896.967346:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521085952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141896.967353:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783141896.967400:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521085952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783141897.092419:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141897.477608:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521086080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783141897.477680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141897.477954:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521086080 00000100:00100000:3.0:1783141897.477963:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521086080 00000100:00100000:3.0:1783141897.478027:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783141897.478038:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521086080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141897.478071:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141897.478119:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521086080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141897.478126:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783141897.478173:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521086080:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783141897.478303:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141897.532804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.533068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501073792 00000100:00100000:0.0:1783141897.533078:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501073792 00000100:00100000:0.0:1783141897.533138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783141897.533148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11127:x1869759501073792:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141897.533168:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141897.533187:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e619 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533266:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533313:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533327:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533335:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533342:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533385:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.533393:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534380:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534393:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ee00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141897.534397:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534424:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534438:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:0.0:1783141897.534440:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.534445:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534451:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a3807106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534463:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534469:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534474:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534478:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141897.534481:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534486:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534492:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f9c7b5c1b00) 00010000:00010000:0.0:1783141897.534502:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.534505:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534519:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380710d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534557:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e619 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534574:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:0.0:1783141897.534576:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.534579:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38070ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e619 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.534593:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ea00, rc 0) 00000100:00100000:0.0:1783141897.534653:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11127:x1869759501073792:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1507us (1859us total) trans 0 rc 301/301 00000100:00100000:0.0:1783141897.534661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00080000:0.0:1783141897.534689:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141897.549382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.550152:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074048 00000100:00100000:0.0:1783141897.550163:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074048 00000100:00100000:0.0:1783141897.550227:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783141897.550237:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11127:x1869759501074048:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1783141897.550320:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141897.550346:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38070b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e604 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550362:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:0.0:1783141897.550371:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141897.550450:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550464:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550473:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550484:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550490:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.550508:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.552927:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.552949:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.552961:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141897.552979:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008894edbc reply state 0000000086db8d7e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.552991:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.552999:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141897.553008:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141897.553011:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783141897.553017:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783141897.553025:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553031:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553037:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553043:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ec00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141897.553058:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553066:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553076:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141897.553078:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.553081:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553087:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807114 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141897.553103:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008894edbc reply state 0000000086db8d7e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553111:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.553125:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f9c7b5c1000) 00010000:00010000:0.0:1783141897.553127:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141897.553130:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783141897.553232:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:11127:x1869759501074048:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 2994us (3857us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783141897.553241:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1783141897.628042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141897.628183:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074176 00000100:00100000:3.0:1783141897.628193:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074176 00000100:00100000:3.0:1783141897.628252:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783141897.628262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:11135:x1869759501074176:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:3.0:1783141897.628330:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141897.628352:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e620 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628765:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628781:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628810:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141897.628856:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141897.628860:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141897.628895:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628922:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e620 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628937:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e620 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.628947:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:3.0:1783141897.628949:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141897.628952:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cda00, rc 0) 00000100:00100000:3.0:1783141897.629012:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:11135:x1869759501074176:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 751us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141897.629020:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783141897.684809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.685015:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074304 00000100:00100000:0.0:1783141897.685026:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074304 00000100:00100000:0.0:1783141897.685110:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1783141897.685120:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7632ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:11141:x1869759501074304:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141897.685141:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141897.685335:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e627 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685403:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685418:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685429:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685441:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685448:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685471:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685542:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685551:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685558:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141897.685592:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783141897.685597:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141897.685643:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685656:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685662:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685669:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685674:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141897.685679:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685686:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685706:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:0.0:1783141897.685709:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.685714:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685720:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380713e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685732:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685737:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685743:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685748:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141897.685751:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685756:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685763:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f9c7b5c1000) 00010000:00010000:0.0:1783141897.685765:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141897.685768:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685773:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807145 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685808:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e627 expref: 13 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685820:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e627 expref: 12 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.685827:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141897.685829:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783141897.685832:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ee00, rc 0) 00000100:00100000:0.0:1783141897.686254:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7632ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:11141:x1869759501074304:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1131us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141897.686262:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:2.0:1783141897.690009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141897.690112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074560 00000100:00100000:1.0:1783141897.690123:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074560 00000100:00100000:1.0:1783141897.690190:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:1.0:1783141897.690200:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:11141:x1869759501074560:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141897.690233:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141897.690252:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807153 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e62e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690790:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690808:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690819:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690891:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690899:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.690906:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141897.691245:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783141897.691550:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691562:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691810:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691854:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691861:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691869:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691875:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141897.691879:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691886:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691898:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141897.691901:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141897.691904:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691910:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a380715a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141897.691923:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008780f5cc reply state 0000000068013803 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691933:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691938:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:1.0:1783141897.691945:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141897.691948:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783141897.691978:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807153 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691992:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.691998:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:1.0:1783141897.692000:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141897.692002:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2000, rc 0) 00000100:00100000:1.0:1783141897.692122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:11141:x1869759501074560:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1923us (2123us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783141897.692130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783141897.702864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.707143:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074688 00000100:00100000:0.0:1783141897.707158:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074688 00000100:00100000:0.0:1783141897.707219:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:0.0:1783141897.707227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501074688:12345-192.168.203.39@tcp:8:bash.0 00010000:00080000:0.0:1783141897.707261:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1783141897.707304:0:8440:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a3807176 00002000:00100000:0.0:1783141897.707314:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 51a41658-4bb5-47ac-acec-f543eb9c9e19/ffff9f9c4a2f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141897.707324:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141897.707391:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783141897.707739:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f9c4a2f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141897.707853:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501074688:12345-192.168.203.39@tcp:8:bash.0 Request processed in 624us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141897.707861:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:3.0:1783141897.718247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.718512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074816 00000100:00100000:0.0:1783141897.718522:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074816 00000100:00100000:0.0:1783141897.718602:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783141897.718613:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:0:x1869759501074816:12345-192.168.203.39@tcp:101:bash.0 00000100:00080000:1.0:1783141897.718642:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783141897.718657:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141897.718681:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e635 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141897.718706:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783141897.718723:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1783141897.718727:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141897.718736:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.718757:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.718770:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ec00, rc 0) 00000100:00100000:0.0:1783141897.718832:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:0:x1869759501074816:12345-192.168.203.39@tcp:101:bash.0 Request processed in 222us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141897.718839:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1783141897.730144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141897.730481:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501074944 00000100:00100000:3.0:1783141897.730491:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501074944 00000100:00100000:3.0:1783141897.730582:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1783141897.730592:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11141:x1869759501074944:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141897.730611:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141897.730640:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e63c expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.730671:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.730681:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141897.730686:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141897.730691:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.730723:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.730737:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 8 pid: 8438 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141897.730750:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521086208:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141897.730855:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141897.734964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.735122:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501075072 00000100:00100000:0.0:1783141897.735131:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501075072 00010000:00010000:0.0:1783141897.735170:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 9 pid: 8438 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141897.735210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783141897.735233:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c48c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501075072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141897.735247:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141897.735265:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 9 pid: 8438 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.735315:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 9 pid: 8438 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.735340:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141897.735344:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141897.735352:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.735363:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.735399:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141897.735415:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1869759521086336:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783141897.735501:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aabf00 going to sleep for 11 seconds 00010000:00010000:3.0:1783141897.735583:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059f281a2/0xb31399d6a380717d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e635 expref: 9 pid: 8438 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141897.735597:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521086208:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141897.735619:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.735640:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cde00, rc 0) 00000100:00100000:3.0:1783141897.735666:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:11141:x1869759501074944:12345-192.168.203.39@tcp:101:bash.0 Request processed in 5076us (5533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141897.735673:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1783141897.738915:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1869759521086336:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783141897.738940:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141897.738998:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c48c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501075072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3765us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141897.739028:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:2.0:1783141897.739231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141897.739432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501075328 00000100:00100000:3.0:1783141897.739441:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501075328 00000100:00100000:3.0:1783141897.739480:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783141897.739488:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:11141:x1869759501075328:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:3.0:1783141897.739800:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11141:x1869759501075328:12345-192.168.203.39@tcp:35:bash.0 Request processed in 312us (569us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783141897.739808:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1783141897.839587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141897.839686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501075584 00000100:00100000:3.0:1783141897.839697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501075584 00000100:00100000:3.0:1783141897.839757:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1783141897.839768:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11151:x1869759501075584:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141897.839792:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141897.839824:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380718b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e643 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141897.839937:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783141897.840031:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380718b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e643 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.840056:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:3.0:1783141897.840072:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141897.840079:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380718b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e643 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.840093:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd600, rc 0) 00000100:00100000:3.0:1783141897.840154:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:11151:x1869759501075584:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 388us (576us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783141897.840162:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783141897.843216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.843317:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501075840 00000100:00100000:0.0:1783141897.843327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501075840 00000100:00100000:0.0:1783141897.843386:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783141897.843395:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:11151:x1869759501075840:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141897.843598:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:11151:x1869759501075840:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 204us (391us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783141897.843606:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783141897.940115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.941003:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501075968 00000100:00100000:0.0:1783141897.941013:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501075968 00000100:00100000:0.0:1783141897.941086:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783141897.941096:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:11157:x1869759501075968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141897.941121:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141897.941139:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e64a expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941201:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941215:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941228:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141897.941292:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783141897.941296:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141897.941329:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941353:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e64a expref: 20 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941370:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e64a expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.941379:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141897.941382:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141897.941385:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ea00, rc 0) 00000100:00100000:0.0:1783141897.941447:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:11157:x1869759501075968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 354us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141897.941454:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:2.0:1783141897.947868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141897.947941:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076224 00000100:00100000:1.0:1783141897.947950:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076224 00000100:00100000:1.0:1783141897.948009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:1.0:1783141897.948018:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:11157:x1869759501076224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141897.948039:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141897.948071:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38071a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e651 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.948174:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38071ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.948198:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38071ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.948235:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38071ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141897.948246:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783141897.948369:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38071a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e651 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.948387:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38071ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e651 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.948415:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:1.0:1783141897.948418:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141897.948422:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:1.0:1783141897.948485:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11157:x1869759501076224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 467us (624us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783141897.948492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:2.0:1783141897.952133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.953031:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076480 00000100:00100000:0.0:1783141897.953042:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076480 00000100:00100000:0.0:1783141897.953134:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783141897.953144:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11157:x1869759501076480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141897.953168:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141897.953187:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38071bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e658 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.953311:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.953326:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.953337:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141897.953362:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783141897.953468:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38071bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e658 expref: 24 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.953485:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e658 expref: 23 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.953504:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:0.0:1783141897.953507:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141897.953510:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141897.953565:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:11157:x1869759501076480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 422us (1441us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783141897.953573:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:2.0:1783141897.960825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141897.960913:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076608 00000100:00100000:3.0:1783141897.960922:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076608 00000100:00100000:3.0:1783141897.960989:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783141897.960999:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:2403:x1869759501076608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141897.961014:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141897.961038:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38071ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e651 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141897.961068:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:3.0:1783141897.961073:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141897.961152:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2403:x1869759501076608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141897.961160:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783141897.969992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141897.970109:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076736 00000100:00100000:0.0:1783141897.970118:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076736 00000100:00100000:0.0:1783141897.970175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783141897.970185:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2400:x1869759501076736:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1783141897.970228:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.970247:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.970257:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783141897.970261:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141897.970265:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.970335:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.970349:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 7 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141897.970364:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521086464:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141897.970473:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141897.973582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141897.973725:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076864 00000100:00100000:1.0:1783141897.973734:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076864 00002000:00100000:1.0:1783141897.973777:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f9c763be680 x1869759501076864/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:273/0 lens 504/0 e 0 to 0 dl 1783141908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141897.973788:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c763be680 with x1869759501076864 ext(0->12) 00010000:00010000:1.0:1783141897.973797:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 8 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.973813:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 8 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141897.973839:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9c763be680 00000100:00100000:1.0:1783141897.973875:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783141897.973885:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501076864:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:0.0:1783141897.976776:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521086464:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141897.976803:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783141897.978377:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000100:00100000:2.0:1783141897.990578:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501076864:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 16685us (16996us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783141897.990598:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00002000:00100000:2.0:1783141897.990611:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f9c763be680 x1869759501076864/t4294967300(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:273/0 lens 504/448 e 0 to 0 dl 1783141908 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141897.990640:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c763be680 with x1869759501076864 ext(0->12) 00010000:00010000:2.0:1783141897.990651:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141897.990670:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141897.990678:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9c763be680 00000100:00100000:2.0:1783141898.009979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.010099:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501076992 00000100:00100000:1.0:1783141898.010109:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501076992 00010000:00010000:1.0:1783141898.010205:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.010247:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:1.0:1783141898.010257:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2401:x1869759501076992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141898.010310:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783141898.010327:0:9526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783141898.010330:0:9526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783141898 00002000:00010000:1.0:1783141898.010333:0:9526:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783141898 00002000:00010000:1.0:1783141898.010335:0:9526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783141898 00002000:00010000:1.0:1783141898.010336:0:9526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783141898.010342:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.010354:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.010379:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000676b09c/0xb31399d6a3807184 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e63c expref: 9 pid: 8439 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.010528:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141898.010533:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141898.010539:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.010547:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.010579:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141898.010679:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010690:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010710:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010719:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010739:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010746:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141898.010749:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010757:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010769:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.010775:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8f67940/0xb31399d6a38071d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141898.010862:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2400:x1869759501076736:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 40676us (40878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141898.010871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:1.0:1783141898.011109:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501076992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 853us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141898.011117:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:2.0:1783141898.013455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141898.013516:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501077248 00000100:00100000:0.0:1783141898.013525:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501077248 00000100:00100000:0.0:1783141898.013580:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:0.0:1783141898.013599:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11157:x1869759501077248:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1783141898.013661:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e658 expref: 22 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141898.013879:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1783141898.013925:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783141898.014211:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1783141898.014248:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.014264:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.014320:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.014355:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.014370:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 26 pid: 6524 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141898.014384:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521086592:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141898.014479:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141898.018537:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521086592:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141898.018539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1783141898.018568:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.021295:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501077376 00000100:00100000:1.0:1783141898.021312:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501077376 00010000:00010000:1.0:1783141898.021359:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 27 pid: 6524 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.021405:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1783141898.021414:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:2402:x1869759501077376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141898.021429:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141898.021435:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 27 pid: 6524 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021449:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 27 pid: 6524 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021491:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e62e expref: 27 pid: 6524 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021509:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:1.0:1783141898.021514:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021524:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021531:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.021562:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141898.021615:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.021627:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141898.021786:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1783141898.026467:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1783141898.026622:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521086720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783141898.026688:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141898.026726:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141898.027106:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521086720 00000100:00100000:2.0:1783141898.027110:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:2402:x1869759501077376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5693us (8577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141898.027114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521086720 00000100:00100000:2.0:1783141898.027126:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:0.0:1783141898.027177:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783141898.027187:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1869759521086720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1783141898.027284:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141898.027323:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1869759521086720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141898.027348:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783141898.027409:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521086720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141898.027867:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1783141898.027924:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521086848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783141898.027962:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141898.027994:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141898.028436:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521086848 00000100:00100000:2.0:1783141898.028443:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521086848 00000100:00100000:2.0:1783141898.028527:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783141898.028536:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1869759521086848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141898.028923:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1869759521086848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 387us (958us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783141898.028931:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783141898.029655:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521086848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141898.029717:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1783141898.029760:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029771:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029779:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029785:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141898.029789:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029797:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029814:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:0.0:1783141898.029817:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783141898.029821:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.029828:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38071d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141898.029943:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783141898.030004:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1783141898.030017:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409096744238ns, next at 410096742170ns, rc = 0 00000001:00080000:0.0:1783141898.030024:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1783141898.030057:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a800) 00010000:00010000:0.0:1783141898.030060:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141898.030068:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38071c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e658 expref: 30 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141898.030182:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:11157:x1869759501077248:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 16593us (16733us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1783141898.030191:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000020:00080000:0.0:1783141898.030195:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783141898.032905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.032978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501077504 00000100:00100000:1.0:1783141898.032988:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501077504 00000100:00100000:1.0:1783141898.033056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1783141898.033066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:11157:x1869759501077504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141898.033091:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141898.033113:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a38071df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e65f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.033180:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a38071df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e65f expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.033196:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a38071df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e65f expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.033230:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141898.033242:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141898.033246:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2000, rc 0) 00000100:00100000:1.0:1783141898.033330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11157:x1869759501077504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 265us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141898.033337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783141898.036639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141898.036913:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501077760 00000100:00100000:2.0:1783141898.036923:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501077760 00000100:00100000:2.0:1783141898.036984:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783141898.036995:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11157:x1869759501077760:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783141898.037313:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+31:11157:x1869759501077760:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 319us (680us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783141898.037335:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00010000:00010000:1.0:1783141898.117547:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141898.133481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.141427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501078016 00000100:00100000:1.0:1783141898.141442:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501078016 00000100:00100000:1.0:1783141898.141505:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1783141898.141515:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+31:11168:x1869759501078016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141898.141541:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141898.141560:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38071e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e666 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141898.141787:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783141898.141877:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38071e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e666 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.141891:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:1.0:1783141898.141894:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141898.141899:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38071e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e666 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.141913:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3e00, rc 0) 00000100:00100000:1.0:1783141898.142226:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11168:x1869759501078016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 711us (8752us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1783141898.142248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:2.0:1783141898.159986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141898.162769:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501078144 00000100:00100000:0.0:1783141898.162786:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501078144 00000100:00100000:3.0:1783141898.162983:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1783141898.162996:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11168:x1869759501078144:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1783141898.163083:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163100:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163116:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163127:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163151:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163158:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163243:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163252:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163260:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141898.163349:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163362:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163368:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163375:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163381:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141898.163385:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163392:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163412:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141898.163415:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141898.163420:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163425:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38071f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163437:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163443:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163449:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163454:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141898.163457:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163463:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163470:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:3.0:1783141898.163472:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141898.163475:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163480:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38071fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163500:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163506:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163512:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163517:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141898.163519:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163525:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163533:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141898.163536:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141898.163538:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.163544:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141898.163623:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11168:x1869759501078144:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 629us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141898.163631:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:0.0:1783141898.167436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141898.167744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501078400 00000100:00100000:2.0:1783141898.167755:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501078400 00000100:00100000:2.0:1783141898.167812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783141898.167829:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11168:x1869759501078400:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783141898.168067:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:11168:x1869759501078400:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 238us (638us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1783141898.168075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783141898.229500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.229661:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501078656 00000100:00100000:1.0:1783141898.229681:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501078656 00000100:00100000:1.0:1783141898.229787:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:1.0:1783141898.229797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:11171:x1869759501078656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141898.229822:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141898.229840:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807209 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e66d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229942:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229957:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229969:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229980:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229987:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.229993:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230228:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230252:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230259:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141898.230297:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783141898.230405:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230424:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230432:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230437:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141898.230456:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230464:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230476:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141898.230495:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141898.230498:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230505:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807210 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230610:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230623:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230628:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230634:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141898.230637:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230643:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230652:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:1.0:1783141898.230654:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141898.230657:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230725:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230771:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807209 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230785:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.230792:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141898.230794:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141898.230803:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3200, rc 0) 00000100:00100000:1.0:1783141898.230873:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11171:x1869759501078656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1077us (1391us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1783141898.230881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:2.0:1783141898.237546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.238817:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501078784 00000100:00100000:1.0:1783141898.238829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501078784 00000100:00100000:1.0:1783141898.238899:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:1.0:1783141898.238909:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11171:x1869759501078784:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:1.0:1783141898.238973:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.238989:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239000:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239035:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239041:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239057:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239062:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141898.239066:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239073:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239098:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141898.239101:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141898.239106:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.239112:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380722c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.239196:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11171:x1869759501078784:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 287us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141898.239204:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:2.0:1783141898.243652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141898.247877:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501079040 00000100:00100000:3.0:1783141898.247891:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501079040 00000100:00100000:3.0:1783141898.248003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783141898.248029:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11171:x1869759501079040:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783141898.248252:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:11171:x1869759501079040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 225us (4607us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1783141898.248260:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1783141898.559322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141898.559426:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501079296 00000100:00100000:3.0:1783141898.559436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501079296 00000100:00100000:3.0:1783141898.559500:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:3.0:1783141898.559511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:11202:x1869759501079296:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783141898.559535:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141898.559555:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807233 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e674 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.559674:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380723a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.559689:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380723a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.559700:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380723a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141898.559724:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783141898.559866:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e674 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.559883:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380723a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e674 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.559904:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141898.559908:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141898.559912:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:3.0:1783141898.559970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11202:x1869759501079296:12345-192.168.203.39@tcp:101:cat.0 Request processed in 461us (702us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783141898.559977:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:0.0:1783141898.571802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141898.571850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141898.571939:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501079680 00000100:00100000:3.0:1783141898.571949:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501079680 00000100:00100000:3.0:1783141898.572054:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783141898.572065:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:2402:x1869759501079680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783141898.572068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501079552 00000100:00100000:1.0:1783141898.572075:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501079552 00010000:00010000:3.0:1783141898.572083:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141898.572109:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380723a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e674 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.572113:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783141898.572125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11202:x1869759501079552:12345-192.168.203.39@tcp:35:cat.0 00010000:00010000:3.0:1783141898.572132:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141898.572138:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141898.572203:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:2402:x1869759501079680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141898.572211:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1783141898.572352:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11202:x1869759501079552:12345-192.168.203.39@tcp:35:cat.0 Request processed in 228us (559us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1783141898.572360:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783141898.659256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141898.659559:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501079936 00000100:00100000:0.0:1783141898.659577:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501079936 00000100:00100000:0.0:1783141898.659633:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783141898.659642:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11208:x1869759501079936:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1783141898.659664:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141898.659667:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141898.660026:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38071a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e64a expref: 38 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660071:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141898.660077:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141898.660092:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807248 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e67b expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660218:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660233:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660241:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660370:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141898.660384:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 38 pid: 6522 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141898.660408:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521086976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141898.660519:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084000 going to sleep for 11 seconds 00000100:00100000:0.0:1783141898.664170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141898.664243:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080064 00000100:00100000:3.0:1783141898.664251:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080064 00010000:00010000:3.0:1783141898.664324:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 39 pid: 6522 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141898.664359:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:3.0:1783141898.664391:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:2403:x1869759501080064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141898.664406:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141898.664413:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 39 pid: 6522 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.664427:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 39 pid: 6522 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.664450:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141898.664455:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.664464:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.664472:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141898.664504:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141898.664556:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:2403:x1869759501080064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 166us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141898.664564:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00010000:00010000:1.0:1783141898.665057:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380721e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e66d expref: 38 pid: 6522 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.665076:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4367bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521086976:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141898.665096:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.665104:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.665123:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141898.665142:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783141898.665321:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807248 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 39 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.665337:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 38 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.665345:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141898.665348:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783141898.665350:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:1.0:1783141898.665398:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11208:x1869759501079936:12345-192.168.203.39@tcp:101:dd.0 Request processed in 5757us (6152us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783141898.665407:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783141898.671768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141898.671921:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080192 00000100:00100000:2.0:1783141898.671930:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080192 00000100:00100000:2.0:1783141898.671998:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1783141898.672006:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11208:x1869759501080192:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783141898.672027:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141898.672057:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380725d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e682 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672090:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672104:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672127:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672237:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380725d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 40 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672255:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 39 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141898.672264:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:2.0:1783141898.672266:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141898.672299:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0800, rc 0) 00000100:00100000:2.0:1783141898.672354:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:11208:x1869759501080192:12345-192.168.203.39@tcp:101:dd.0 Request processed in 348us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141898.672361:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:3.0:1783141898.676251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.676797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080448 00000100:00100000:1.0:1783141898.676807:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080448 00000100:00100000:1.0:1783141898.676924:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1783141898.676935:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:11208:x1869759501080448:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:1.0:1783141898.677155:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.677173:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.677184:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141898.677248:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1783141898.677307:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bdfb8f9 reply state 00000000bc812ff8 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.677321:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.677329:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141898.677332:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141898.677336:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141898.677434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:11208:x1869759501080448:12345-192.168.203.39@tcp:36:dd.0 Request processed in 500us (1190us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1783141898.677442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000020:00080000:1.0:1783141898.677447:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783141898.988731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141898.988838:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080576 00000100:00100000:1.0:1783141898.988848:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080576 00000100:00100000:1.0:1783141898.988912:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783141898.988921:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:11222:x1869759501080576:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1783141898.988946:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141898.988966:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e689 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989033:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989059:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989071:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989098:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989106:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989113:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989189:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989199:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 43 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989206:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989239:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 43 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141898.989250:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 43 pid: 7934 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141898.989264:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521087104:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141898.989407:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141898.991338:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521087104:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141898.991375:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141898.995824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141898.995945:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080832 00000100:00100000:3.0:1783141898.995956:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080832 00000100:00100000:3.0:1783141898.996015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783141898.996025:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:6168:x1869759501080832:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783141898.997748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+45:6168:x1869759501080832:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 1716us (1924us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1783141898.997774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783141899.000056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.000215:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501080960 00000100:00100000:0.0:1783141899.000572:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501080960 00010000:00010000:0.0:1783141899.000629:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 45 pid: 7934 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141899.000669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:0.0:1783141899.000677:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+45:2402:x1869759501080960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141899.000692:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141899.000698:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 45 pid: 7934 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.000710:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 45 pid: 7934 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.000743:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a380724f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e67b expref: 45 pid: 7934 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.000758:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.000764:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.000773:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.000781:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783141899.000871:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783141899.000940:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141899.000997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:2402:x1869759501080960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 320us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.001015:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00010000:00010000:2.0:1783141899.002600:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002613:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141899.002668:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783141899.002672:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141899.002792:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002808:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002832:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002839:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002846:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002851:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141899.002855:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002862:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002885:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141899.002888:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141899.002893:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002899:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002915:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002920:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002926:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002937:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141899.002940:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002946:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002955:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:2.0:1783141899.002957:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141899.002960:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.002966:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.003000:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e689 expref: 44 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.003014:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e689 expref: 43 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.003021:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:2.0:1783141899.003024:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141899.003026:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:2.0:1783141899.003096:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:11222:x1869759501080576:12345-192.168.203.39@tcp:101:stat.0 Request processed in 14175us (14373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141899.003104:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783141899.084897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141899.084996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501081216 00000100:00100000:3.0:1783141899.085005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501081216 00000100:00100000:3.0:1783141899.085127:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:3.0:1783141899.085138:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:11228:x1869759501081216:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:3.0:1783141899.085191:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141899.085216:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e689 expref: 43 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.085236:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141899.085241:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141899.085458:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.085473:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.085483:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141899.085522:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1783141899.085542:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ccaf8a94 reply state 000000003da54523 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.085554:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.085561:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141899.085571:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141899.085573:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141899.085681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+45:11228:x1869759501081216:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 544us (792us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783141899.085688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000020:00080000:3.0:1783141899.085693:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141899.140677:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141899.216181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.218103:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501081344 00000100:00100000:1.0:1783141899.218119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501081344 00000100:00100000:1.0:1783141899.218405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:1.0:1783141899.218416:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+45:11242:x1869759501081344:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1783141899.218440:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141899.218458:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807295 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e690 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218518:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218532:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218542:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218553:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218560:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218567:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218650:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218675:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141899.218722:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783141899.218726:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141899.218747:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218757:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218766:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218772:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218778:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218784:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141899.218788:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218795:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218806:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141899.218814:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141899.218819:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218825:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380729c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218838:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218844:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218849:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218854:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141899.218857:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218862:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218869:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:1.0:1783141899.218872:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141899.218874:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218879:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218924:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807295 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218949:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.218956:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.218959:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141899.218961:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:1.0:1783141899.219029:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+46:11242:x1869759501081344:12345-192.168.203.39@tcp:101:stat.0 Request processed in 615us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.219046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:1.0:1783141899.348324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141899.348433:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501081600 00000100:00100000:2.0:1783141899.348444:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501081600 00000100:00100000:2.0:1783141899.348502:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:2.0:1783141899.348512:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+46:11252:x1869759501081600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141899.348535:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141899.348553:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38072b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e697 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141899.348657:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783141899.348755:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38072b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e697 expref: 48 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.348768:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:2.0:1783141899.348771:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141899.348776:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38072b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e697 expref: 48 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.348790:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:2.0:1783141899.348858:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:11252:x1869759501081600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 347us (590us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1783141899.348865:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:0.0:1783141899.358113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.358205:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501081856 00000100:00100000:1.0:1783141899.358215:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501081856 00000100:00100000:1.0:1783141899.358301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:1.0:1783141899.358311:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:11252:x1869759501081856:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783141899.358544:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:11252:x1869759501081856:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 233us (439us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1783141899.358552:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:3.0:1783141899.435358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141899.436001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501082112 00000100:00100000:2.0:1783141899.436011:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501082112 00000100:00100000:2.0:1783141899.436085:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783141899.436094:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:11258:x1869759501082112:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141899.436119:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141899.436139:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a38072bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e69e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.436257:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.436459:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.436470:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.436506:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141899.436519:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 49 pid: 6522 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141899.436532:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43575c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521087232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141899.436663:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141899.440790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.441114:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501082240 00000100:00100000:0.0:1783141899.441123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501082240 00010000:00010000:0.0:1783141899.441160:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 50 pid: 6522 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141899.441192:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:0.0:1783141899.441200:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4eb77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:2402:x1869759501082240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141899.441214:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141899.441220:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 50 pid: 6522 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.441232:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 50 pid: 6522 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.441252:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.441257:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.441267:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.441300:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.441318:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141899.441384:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4eb77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:2402:x1869759501082240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.441402:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00010000:00010000:3.0:1783141899.442745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e690 expref: 49 pid: 6522 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141899.442768:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43575c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521087232:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141899.442788:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.442797:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.442803:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141899.442820:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1783141899.443053:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a38072bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.443069:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.443077:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141899.443079:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141899.443091:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1a00, rc 0) 00000100:00100000:3.0:1783141899.443188:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:11258:x1869759501082112:12345-192.168.203.39@tcp:101:bash.0 Request processed in 7094us (7838us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1783141899.443196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783141899.447739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.447845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501082496 00000100:00100000:1.0:1783141899.447854:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501082496 00000100:00100000:1.0:1783141899.448548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:1.0:1783141899.448561:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:11258:x1869759501082496:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:1.0:1783141899.448796:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.448814:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.448832:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141899.448873:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1783141899.448974:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025814b95 reply state 00000000c9a01b71 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.448989:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.448997:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.449000:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141899.449003:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141899.449141:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:11258:x1869759501082496:12345-192.168.203.39@tcp:36:bash.0 Request processed in 583us (1408us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1783141899.449150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000020:00080000:1.0:1783141899.449155:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783141899.454752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.454845:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501082624 00000100:00100000:1.0:1783141899.454855:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501082624 00000100:00100000:1.0:1783141899.454918:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:1.0:1783141899.454928:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:11258:x1869759501082624:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141899.454950:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141899.454969:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6a5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.455076:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.455091:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.455114:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.455145:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.455157:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 53 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141899.455171:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869759521087360:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141899.455256:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141899.458505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141899.458579:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501082752 00000100:00100000:3.0:1783141899.458587:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501082752 00010000:00010000:3.0:1783141899.458622:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 54 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141899.458661:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:3.0:1783141899.458670:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:2403:x1869759501082752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141899.458685:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141899.458692:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 54 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.458704:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 54 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.458726:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141899.458731:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.458741:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.458748:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.458766:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141899.458834:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:2403:x1869759501082752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141899.458843:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00010000:00010000:1.0:1783141899.459293:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a38072c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e69e expref: 53 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141899.459317:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869759521087360:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141899.459337:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.459347:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.459353:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141899.459416:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783141899.459421:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141899.459441:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.459479:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6a5 expref: 53 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.459496:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6a5 expref: 52 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.459504:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.459507:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141899.459510:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:1.0:1783141899.459553:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:11258:x1869759501082624:12345-192.168.203.39@tcp:101:bash.0 Request processed in 4626us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.459560:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783141899.467352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.467435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501083008 00000100:00100000:1.0:1783141899.467444:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501083008 00000100:00100000:1.0:1783141899.467505:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783141899.467516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:11258:x1869759501083008:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:1.0:1783141899.467734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11258:x1869759501083008:12345-192.168.203.39@tcp:35:bash.0 Request processed in 218us (389us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1783141899.467742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783141899.547098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141899.547177:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501083264 00000100:00100000:3.0:1783141899.547187:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501083264 00000100:00100000:3.0:1783141899.547241:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783141899.547250:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11268:x1869759501083264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141899.547305:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141899.547323:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38072e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6ac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141899.547744:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783141899.547832:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38072e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6ac expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.547847:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:3.0:1783141899.547850:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141899.547855:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a38072e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6ac expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141899.548019:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:2.0:1783141899.548266:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11268:x1869759501083264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1014us (1174us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1783141899.548295:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:0.0:1783141899.557087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.557177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501083392 00000100:00100000:1.0:1783141899.557186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501083392 00000100:00100000:1.0:1783141899.557239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:1.0:1783141899.557247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11268:x1869759501083392:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783141899.557338:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557372:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557392:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557406:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557413:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557421:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557501:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557511:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557518:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141899.557563:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557576:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557583:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557601:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557606:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141899.557610:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557617:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557628:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141899.557631:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141899.557635:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38072f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557654:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557660:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557665:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557670:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141899.557673:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557687:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557694:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:1.0:1783141899.557697:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141899.557699:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557704:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38072fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557713:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557718:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557724:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557728:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141899.557730:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557735:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.557743:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141899.557745:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.557758:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a3807305 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141899.557828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11268:x1869759501083392:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 581us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.557837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:0.0:1783141899.567764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.567874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501083648 00000100:00100000:1.0:1783141899.567883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501083648 00000100:00100000:1.0:1783141899.567946:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783141899.567955:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11268:x1869759501083648:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783141899.568181:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:11268:x1869759501083648:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 226us (424us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1783141899.568189:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:2.0:1783141899.620709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.620769:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501083904 00000100:00100000:1.0:1783141899.620778:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501083904 00000100:00100000:1.0:1783141899.620837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783141899.620847:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:11271:x1869759501083904:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141899.620869:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141899.621097:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a380730c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6b3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621174:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621188:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621220:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621232:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621239:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621245:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621412:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807321 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621421:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.621428:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141899.621436:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141899.622115:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622124:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622130:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622135:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.622138:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622145:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622167:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141899.622170:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.622174:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622179:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345e00/0xb31399d6a3807313 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622203:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622209:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622215:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622219:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.622222:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622227:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622233:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:0.0:1783141899.622235:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.622237:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622242:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a380731a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622358:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345400/0xb31399d6a380730c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6b3 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622373:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807321 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6b3 expref: 57 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.622392:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.622394:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141899.622397:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3e00, rc 0) 00000100:00100000:0.0:1783141899.622462:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:11271:x1869759501083904:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1617us (1761us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1783141899.622471:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:0.0:1783141899.628043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.628186:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501084032 00000100:00100000:1.0:1783141899.628362:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501084032 00000100:00100000:1.0:1783141899.628427:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783141899.628438:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:2403:x1869759501084032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141899.628454:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141899.628477:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807321 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6b3 expref: 57 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.628516:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.628521:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141899.628750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:2403:x1869759501084032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 312us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.628758:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783141899.630227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.630327:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501084160 00000100:00100000:0.0:1783141899.630336:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501084160 00000100:00100000:0.0:1783141899.630381:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:0.0:1783141899.630392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:11271:x1869759501084160:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:0.0:1783141899.630452:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630468:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630480:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630515:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630522:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630530:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630552:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.630557:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630565:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630577:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.630580:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141899.630584:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.630590:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380732f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141899.630648:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:11271:x1869759501084160:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 258us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.630656:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:2.0:1783141899.640251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.640499:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501084416 00000100:00100000:1.0:1783141899.640508:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501084416 00000100:00100000:1.0:1783141899.640565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783141899.640575:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:11271:x1869759501084416:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783141899.640791:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:11271:x1869759501084416:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 217us (548us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1783141899.640799:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:2.0:1783141899.806015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.806156:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501084672 00000100:00100000:0.0:1783141899.806166:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501084672 00000100:00100000:0.0:1783141899.806224:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:0.0:1783141899.806233:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:11289:x1869759501084672:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783141899.806256:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141899.806295:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807336 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6ba expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.806426:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380733d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.806457:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380733d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.806470:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380733d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141899.806483:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141899.806584:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807336 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6ba expref: 60 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.806615:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380733d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6ba expref: 59 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.806624:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.806627:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783141899.806630:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141899.806897:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11289:x1869759501084672:12345-192.168.203.39@tcp:101:cat.0 Request processed in 663us (890us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1783141899.806905:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:2.0:1783141899.838808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.838930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501084800 00000100:00100000:0.0:1783141899.838940:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501084800 00000100:00100000:0.0:1783141899.839000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:0.0:1783141899.839010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11290:x1869759501084800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141899.839042:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141899.839061:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380734b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6c1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839145:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839159:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839169:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141899.839213:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783141899.839217:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141899.839235:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839258:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380734b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c1 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839306:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c1 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.839315:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141899.839318:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141899.839321:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fc00, rc 0) 00000100:00100000:0.0:1783141899.839393:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11290:x1869759501084800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 383us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.839401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:1.0:1783141899.845153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141899.845229:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085184 00000100:00100000:3.0:1783141899.845238:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085184 00000100:00100000:3.0:1783141899.845327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141899.845336:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11290:x1869759501085184:12345-192.168.203.39@tcp:35:lfs.0 00000001:00080000:3.0:1783141899.845794:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000100:00100000:3.0:1783141899.845955:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11290:x1869759501085184:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 618us (809us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1783141899.845980:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000020:00080000:3.0:1783141899.845985:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783141899.848868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.849019:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085312 00000100:00100000:1.0:1783141899.849029:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085312 00000100:00100000:1.0:1783141899.849131:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783141899.849141:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11290:x1869759501085312:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:1.0:1783141899.849158:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783141899.849182:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38072e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6a5 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.849205:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380733d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6ba expref: 61 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.849217:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a38071df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e65f expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141899.849243:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141899.849248:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141899.849366:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11290:x1869759501085312:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 225us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.849375:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1783141899.851641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.851761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085440 00000100:00100000:0.0:1783141899.851770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085440 00000100:00100000:0.0:1783141899.851834:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1783141899.851843:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11290:x1869759501085440:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:0.0:1783141899.851972:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.851990:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.852001:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141899.852220:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141899.852462:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783141899.852738:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783141899.852818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11290:x1869759501085440:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 974us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.852827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:2.0:1783141899.871792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.872022:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085568 00000100:00100000:0.0:1783141899.872040:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085568 00000100:00100000:0.0:1783141899.872106:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:0.0:1783141899.872115:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11292:x1869759501085568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141899.872135:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141899.872154:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6c8 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872217:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872231:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872258:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872303:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872313:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872320:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872405:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872415:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872422:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141899.872464:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783141899.872468:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141899.872742:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872754:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872763:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872780:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872788:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872794:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.872798:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872805:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872817:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141899.872820:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.872824:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872830:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a3807367 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872844:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872850:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872857:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872862:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.872870:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872877:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872945:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:0.0:1783141899.872948:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.872952:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872958:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380736e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872986:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 61 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.872998:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 60 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.873005:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.873008:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141899.873011:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141899.873083:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11292:x1869759501085568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 969us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141899.873091:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000040:00080000:1.0:1783141899.977863:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141899.977873:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141899.977933:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783141899.977941:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141899.978103:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521087488:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141899.978290:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141899.981086:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521087488:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141899.984359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141899.985507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085696 00000100:00100000:1.0:1783141899.985518:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085696 00000100:00100000:1.0:1783141899.985576:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:1.0:1783141899.985585:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11303:x1869759501085696:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783141899.985624:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783141899.985992:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11303:x1869759501085696:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 405us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.986000:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783141899.996418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141899.996608:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501085824 00000100:00100000:0.0:1783141899.996626:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501085824 00000100:00100000:0.0:1783141899.996693:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:0.0:1783141899.996703:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11303:x1869759501085824:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783141899.996774:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.996791:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.996932:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.996979:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.996986:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.996992:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997020:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997039:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997046:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141899.997091:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783141899.997096:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141899.997179:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997200:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997207:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997215:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997220:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.997224:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997231:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997243:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:0.0:1783141899.997246:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.997251:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997257:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a380737c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997305:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997312:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997317:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997330:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.997333:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997339:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997347:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141899.997349:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.997352:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997358:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807383 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997374:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997379:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997384:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997389:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141899.997391:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997397:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997416:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:0.0:1783141899.997418:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141899.997422:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141899.997428:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380738a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141899.998623:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11303:x1869759501085824:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 1914us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141899.998635:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:3.0:1783141900.001140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.003158:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501086080 00000100:00100000:0.0:1783141900.003171:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501086080 00000100:00100000:3.0:1783141900.003467:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:3.0:1783141900.003534:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11303:x1869759501086080:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141900.003556:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141900.003575:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807391 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6cf expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.003913:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.003930:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.003942:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141900.003954:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783141900.004028:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004047:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004054:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004071:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141900.004075:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004082:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004095:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141900.004097:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141900.004102:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004180:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a3807398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004220:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807391 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6cf expref: 62 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004231:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:3.0:1783141900.004233:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141900.004237:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807391 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6cf expref: 62 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.004247:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:3.0:1783141900.004326:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086080:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 849us (3193us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1783141900.004335:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:3.0:1783141900.008051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.009046:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501086208 00000100:00100000:0.0:1783141900.009059:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501086208 00000100:00100000:3.0:1783141900.009309:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:3.0:1783141900.009322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086208:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141900.009357:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141900.009474:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086208:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 155us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.009493:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:2.0:1783141900.020504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.021747:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501086464 00000100:00100000:0.0:1783141900.021760:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501086464 00000100:00100000:0.0:1783141900.021844:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1783141900.021855:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.021876:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.021880:0:7934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141900.021904:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c1 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.021923:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141900.021929:0:7934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141900.021941:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6d6 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141900.022335:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783141900.022466:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38073ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.022486:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38073ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.022496:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38073ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.022553:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6d6 expref: 63 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.022567:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38073ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6d6 expref: 62 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.022575:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141900.022577:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141900.022580:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e400, rc 0) 00000100:00100000:0.0:1783141900.026319:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11303:x1869759501086464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 4456us (5814us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783141900.026332:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:2.0:1783141900.034100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.038321:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501086720 00000100:00100000:0.0:1783141900.038336:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501086720 00000100:00100000:0.0:1783141900.038397:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:0.0:1783141900.038407:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11303:x1869759501086720:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.038468:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141900.038494:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38073ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6d6 expref: 62 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038510:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141900.038530:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141900.038552:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038566:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038577:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038590:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038597:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038603:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038663:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038669:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038675:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038681:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.038685:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038692:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038707:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141900.038710:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.038724:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038731:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038741:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038747:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038752:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038756:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.038759:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038764:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038771:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xff88792d (ffff9f9c7b5c1b00) 00010000:00010000:0.0:1783141900.038773:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.038776:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.038782:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xff88792d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.038879:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086720:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 473us (4787us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141900.038886:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:2.0:1783141900.048596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.048657:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501086848 00000100:00100000:0.0:1783141900.048667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501086848 00000100:00100000:0.0:1783141900.048724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:0.0:1783141900.048734:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11303:x1869759501086848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.048759:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.048783:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38073c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048818:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048835:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048847:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048960:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38073c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048977:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.048986:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.048994:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141900.048997:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ea00, rc 0) 00000100:00100000:0.0:1783141900.049066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11303:x1869759501086848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 333us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.049074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:2.0:1783141900.055895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.055978:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501087104 00000100:00100000:0.0:1783141900.055987:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501087104 00000100:00100000:0.0:1783141900.056056:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:0.0:1783141900.056066:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11303:x1869759501087104:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.056149:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.056164:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.056176:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141900.056359:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1783141900.056368:0:7934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411123095269ns, next at 412123092929ns, rc = 0 00000004:00010000:0.0:1783141900.056412:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a1977db reply state 00000000c8418432 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.056425:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.056432:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.056435:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783141900.056438:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141900.056524:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:11303:x1869759501087104:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 459us (647us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1783141900.056539:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:2.0:1783141900.059794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.060171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501087232 00000100:00100000:1.0:1783141900.060183:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501087232 00000100:00100000:1.0:1783141900.060237:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:1.0:1783141900.060255:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:11303:x1869759501087232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141900.060296:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141900.060316:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6e4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.060367:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.060382:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.060401:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:1.0:1783141900.060404:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141900.060408:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:1.0:1783141900.060463:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:11303:x1869759501087232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 210us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.060471:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:0.0:1783141900.069889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.070004:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501087360 00000100:00100000:3.0:1783141900.070014:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501087360 00000100:00100000:3.0:1783141900.070073:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783141900.070081:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501087360:12345-192.168.203.39@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783141900.070185:0:8440:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1783141900.070227:0:8440:0:(genops.c:1406:class_connect()) connect: client 51a41658-4bb5-47ac-acec-f543eb9c9e19, cookie 0xb31399d6a38073e5 00002000:00100000:3.0:1783141900.070241:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 51a41658-4bb5-47ac-acec-f543eb9c9e19/ffff9f9b4372d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783141900.070259:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783141900.070429:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783141900.070459:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f9b4372c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141900.070532:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2399:x1869759501087360:12345-192.168.203.39@tcp:8:lhsmtool_posix.0 Request processed in 449us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.070540:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:1.0:1783141900.072830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.072917:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501087488 00000100:00100000:3.0:1783141900.072927:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501087488 00000100:00100000:3.0:1783141900.073003:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783141900.073012:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:0:x1869759501087488:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783141900.073262:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1783141900.077625:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1783141900.077640:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000100:00100000:3.0:1783141900.077819:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:0:x1869759501087488:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 4802us (4990us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783141900.078372:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:1.0:1783141900.081009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.081090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501087744 00000100:00100000:3.0:1783141900.081100:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501087744 00000100:00100000:3.0:1783141900.081160:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783141900.081171:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:11303:x1869759501087744:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783141900.081435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11303:x1869759501087744:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 265us (434us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1783141900.081444:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1783141900.093257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.093560:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088000 00000100:00100000:2.0:1783141900.093571:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088000 00000100:00100000:2.0:1783141900.093629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:2.0:1783141900.093639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11303:x1869759501088000:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141900.093758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11303:x1869759501088000:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 120us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141900.093766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:1.0:1783141900.105064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.105331:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088128 00000100:00100000:0.0:1783141900.105340:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088128 00000100:00100000:0.0:1783141900.105405:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:0.0:1783141900.105417:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11303:x1869759501088128:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.105447:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.105468:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6eb expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105559:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105573:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105584:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141900.105629:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141900.105648:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105675:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38073ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6eb expref: 68 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105895:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6eb expref: 67 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.105904:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.105907:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783141900.105910:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fa00, rc 0) 00000100:00100000:0.0:1783141900.105982:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11303:x1869759501088128:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 568us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.105990:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:1.0:1783141900.115267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.119471:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088256 00000100:00100000:3.0:1783141900.119486:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088256 00000100:00100000:3.0:1783141900.119550:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:3.0:1783141900.119560:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501088256:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141900.119579:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141900.119600:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6f2 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141900.119633:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48960c, blocks: 0x0 00010000:00010000:3.0:1783141900.119651:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1783141900.119656:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141900.119666:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.119688:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.119730:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:3.0:1783141900.119794:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501088256:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 235us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.119807:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783141900.123901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.125503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088512 00000100:00100000:1.0:1783141900.125515:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088512 00000100:00100000:1.0:1783141900.125583:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:1.0:1783141900.125592:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11303:x1869759501088512:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783141900.125704:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11303:x1869759501088512:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 112us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.125724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:1.0:1783141900.130875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.130956:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088640 00000100:00100000:0.0:1783141900.130966:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088640 00000100:00100000:0.0:1783141900.131019:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1783141900.131038:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:11303:x1869759501088640:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.131057:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.131078:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e6f9 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.131107:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.131116:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141900.131120:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141900.131126:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.131184:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.131197:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 7 pid: 8439 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.131210:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521087616:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141900.131359:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141900.134769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.134902:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088768 00000100:00100000:1.0:1783141900.134912:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088768 00000100:00100000:0.0:1783141900.134952:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521087616:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141900.134953:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 8 pid: 8439 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.134987:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.135002:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00010000:00010000:0.0:1783141900.135006:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fc00, rc 0) 00000100:00100000:1.0:1783141900.135014:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501088768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141900.135040:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141900.135062:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 8 pid: 8439 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.135071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:11303:x1869759501088640:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 4041us (4203us total) trans 0 rc 0/0 00010000:00010000:1.0:1783141900.135080:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 8 pid: 8439 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.135083:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00010000:00010000:1.0:1783141900.135110:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002de64e43/0xb31399d6a38073fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f2 expref: 7 pid: 8439 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.135124:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141900.135128:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141900.135136:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.135145:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.135205:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.135220:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6508:1869759521087744:192.168.203.39@tcp:105: 00000100:00100000:1.0:1783141900.135321:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141900.146602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.146953:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6508:1869759521087744:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783141900.146976:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141900.149470:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501088896 00000100:00100000:2.0:1783141900.149485:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501088896 00002000:00100000:2.0:1783141900.149539:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f9b436e9c00 x1869759501088896/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:276/0 lens 504/0 e 0 to 0 dl 1783141911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141900.149551:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b436e9c00 with x1869759501088896 ext(0->8) 00002000:00010000:2.0:1783141900.149557:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b436e9c00 00000100:00100000:2.0:1783141900.149599:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1783141900.149609:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501088896:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783141900.150265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501088768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15250us (15502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.150290:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:2.0:1783141900.152122:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2401:x1869759501088896:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 2505us (5637us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783141900.152148:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00002000:00100000:2.0:1783141900.152161:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f9b436e9c00 x1869759501088896/t4294967303(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:276/0 lens 504/448 e 0 to 0 dl 1783141911 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141900.152171:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b436e9c00 with x1869759501088896 ext(0->8) 00002000:00010000:2.0:1783141900.152179:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b436e9c00 00000100:00100000:1.0:1783141900.162520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.162768:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089024 00000100:00100000:0.0:1783141900.162778:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089024 00000100:00100000:0.0:1783141900.162855:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:0.0:1783141900.162864:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11303:x1869759501089024:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1783141900.164780:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783141900.165668:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1783141900.165682:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1783141900.165751:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783141900.165775:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9b41084e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783141900.165780:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c7c606e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b410840c0 00000020:00080000:2.0:1783141900.165783:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c7c606d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c7b682600 00000020:00080000:3.0:1783141900.165903:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1783141900.166019:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166040:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166047:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166052:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.166057:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166065:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166081:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f9c7b5c1000) 00010000:00010000:1.0:1783141900.166084:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.166088:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166109:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a380711b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166131:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166137:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166142:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166147:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.166150:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166155:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166163:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141900.166166:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.166168:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166174:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807122 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166188:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166195:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166207:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166213:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.166216:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166223:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166232:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c4e71a700) 00010000:00010000:1.0:1783141900.166235:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.166239:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166245:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c76345200/0xb31399d6a3807161 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166264:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166303:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166311:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.166316:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.166320:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783141900.166329:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1783141900.166342:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141900.166359:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521087872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783141900.166430:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141900.166488:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521087872 00000100:00100000:3.0:1783141900.166495:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521087872 00000100:00100000:3.0:1783141900.166547:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141900.166556:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521087872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783141900.166648:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783141900.166651:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783141900 00002000:00010000:3.0:1783141900.166654:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783141900.166656:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783141900 -> 1783141900 00002000:00010000:3.0:1783141900.166658:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783141900.166695:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521087872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 140us (265us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783141900.166703:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1783141900.166723:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783141900.166915:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b437c8a80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1783141900.166923:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521087872:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1783141900.168071:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168089:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141900.168091:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.168096:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168103:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380726b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168125:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168131:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168136:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168142:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.168145:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168151:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168158:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141900.168161:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.168164:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168185:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380728e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168198:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168204:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168209:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168214:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.168217:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168223:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168231:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141900.168233:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141900.168236:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168242:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38072d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168252:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168258:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168309:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168316:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141900.168319:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168326:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168334:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:1.0:1783141900.168337:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783141900.168340:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.168345:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38073d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.168632:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:11303:x1869759501089024:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 5765us (6119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.168643:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:3.0:1783141900.168951:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521088000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783141900.169017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141900.169921:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521088000 00000100:00100000:0.0:1783141900.169930:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521088000 00000100:00100000:0.0:1783141900.169989:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141900.169997:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521088000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783141900.170022:0:8865:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1783141900.170062:0:8865:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a48960a, atime: 0x6a48960a, ctime: 0x6a48960a, blocks: 0x8 00010000:00010000:0.0:1783141900.170070:0:8865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170083:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1783141900.170087:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141900.170094:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170108:0:8865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170116:0:8865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170122:0:8865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170151:0:8865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783141900.170318:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1869759521088000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 320us (1300us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783141900.170325:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1783141900.170356:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141900.170362:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170370:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141900.170374:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170383:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170400:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170407:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e54d56/0xb31399d6a3807408 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.170426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141900.170428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141900.170429:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141900.171042:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783141900.171082:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9c6f7f9880/2, rc 0, transno 4294967302 00000100:00100000:3.0:1783141900.171090:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521088000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783141900.177572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.182504:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089152 00000100:00100000:3.0:1783141900.182520:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089152 00000100:00100000:3.0:1783141900.182634:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783141900.182644:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2401:x1869759501089152:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783141900.193640:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783141900.193658:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1783141900.194095:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501089152:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 11445us (16524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.194106:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:1.0:1783141900.198344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.198429:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089408 00000100:00100000:0.0:1783141900.198440:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089408 00000100:00100000:0.0:1783141900.198527:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 91 00000100:00100000:0.0:1783141900.198537:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:11303:x1869759501089408:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.198593:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141900.198619:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38073f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6eb expref: 14 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.198639:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.198644:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141900.198675:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.198689:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.198698:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141900.198812:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f70bc6f reply state 00000000d6ba082e transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.198825:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.198831:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.198834:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141900.198836:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141900.198945:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:11303:x1869759501089408:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 409us (609us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1783141900.198953:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 91 00000100:00100000:1.0:1783141900.213831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.214246:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089536 00000100:00100000:2.0:1783141900.214257:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089536 00000100:00100000:2.0:1783141900.214340:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:2.0:1783141900.214352:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501089536:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783141900.214523:0:8865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783141900.214526:0:8865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783141900 -> 1783141900 00002000:00010000:2.0:1783141900.214529:0:8865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783141898 00002000:00010000:2.0:1783141900.214532:0:8865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783141900 -> 1783141900 00002000:00010000:2.0:1783141900.214534:0:8865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783141900.214592:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501089536:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 241us (769us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783141900.214600:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783141900.218844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.219580:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089792 00000100:00100000:2.0:1783141900.219591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089792 00000100:00100000:2.0:1783141900.219649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:2.0:1783141900.219659:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:11303:x1869759501089792:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783141900.219723:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.219740:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.219750:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.219785:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.219799:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 15 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.219813:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bf17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521088128:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141900.220982:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141900.233607:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bf17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521088128:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141900.233652:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.233698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.233771:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501089920 00000100:00100000:0.0:1783141900.233778:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501089920 00010000:00010000:0.0:1783141900.233812:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.233850:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783141900.233859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:2400:x1869759501089920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141900.233873:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141900.233889:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233901:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233923:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38073d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6dd expref: 16 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233937:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.233942:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233951:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233960:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.233987:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141900.234049:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:2400:x1869759501089920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.234057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00010000:00010000:0.0:1783141900.234080:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234087:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234125:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234132:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234139:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234145:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.234149:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234157:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141900.234168:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783141900.234172:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.234188:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807416 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.234232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:11303:x1869759501089792:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 14574us (15396us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783141900.234241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:1.0:1783141900.239362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.239458:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090048 00000100:00100000:3.0:1783141900.239468:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090048 00000100:00100000:3.0:1783141900.239524:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:3.0:1783141900.239534:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501090048:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783141900.239578:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.239598:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.239606:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141900.239610:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141900.239615:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.239661:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.239675:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 7 pid: 8438 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141900.239690:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521088256:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141900.242491:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141900.257300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.257344:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090176 00000100:00100000:1.0:1783141900.257354:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090176 00010000:00010000:1.0:1783141900.257391:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 8 pid: 8438 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.257444:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:1.0:1783141900.257454:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501090176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141900.257469:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141900.257490:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 8 pid: 8438 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.257505:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 8 pid: 8438 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.257528:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141900.257533:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141900.257538:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.257547:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.257566:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141900.257617:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501090176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.257625:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00010000:00010000:2.0:1783141900.258015:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fa04ae/0xb31399d6a3807401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6f9 expref: 7 pid: 8438 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.258038:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521088256:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141900.258059:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258078:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258085:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258105:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258113:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258120:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258127:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141900.258131:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258140:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258152:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.258171:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380741d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.258232:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501090048:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 18699us (18880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141900.258240:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:1.0:1783141900.265214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.265339:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090432 00000100:00100000:0.0:1783141900.265348:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090432 00000100:00100000:0.0:1783141900.265429:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:0.0:1783141900.265440:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:11303:x1869759501090432:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783141900.265520:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.265538:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 14 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.265547:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.265583:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 14 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.265596:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 14 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.265611:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088384:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141900.265696:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141900.274652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.274898:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088384:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141900.274925:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.275041:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090560 00000100:00100000:1.0:1783141900.275048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090560 00010000:00010000:1.0:1783141900.275083:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 15 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.275131:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1783141900.275142:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:2403:x1869759501090560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141900.275158:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141900.275165:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 15 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275178:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 15 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275201:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e682 expref: 15 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275216:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:1.0:1783141900.275221:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275231:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275238:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.275335:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141900.275394:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:2403:x1869759501090560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 252us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.275403:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00010000:00010000:3.0:1783141900.281181:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281198:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281718:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281736:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281745:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281781:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.281797:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 14 pid: 6524 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141900.281820:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088512:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141900.282745:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b6010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141900.287068:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141900.287109:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.289015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.289171:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090688 00000100:00100000:2.0:1783141900.289180:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090688 00010000:00010000:2.0:1783141900.289219:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 15 pid: 6524 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.289249:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783141900.289258:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:2403:x1869759501090688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141900.289295:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141900.289303:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 15 pid: 6524 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289315:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 15 pid: 6524 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289336:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38073de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6e4 expref: 15 pid: 6524 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289358:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:2.0:1783141900.289364:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289373:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289393:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.289422:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141900.289474:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:2403:x1869759501090688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141900.289489:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00010000:00010000:3.0:1783141900.289557:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.289566:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141900.289667:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1783141900.289782:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:3.0:1783141900.289818:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1783141900.289897:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1869759521088640:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783141900.289943:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141900.289976:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141900.290082:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521088640 00000100:00100000:2.0:1783141900.290088:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521088640 00000100:00100000:2.0:1783141900.290125:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783141900.290133:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7934:x1869759521088640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783141900.290209:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7934:x1869759521088640:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141900.290216:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783141900.290248:0:7934:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783141900.290253:0:7934:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b437c8a80, transno 4294967304 00000100:00100000:2.0:1783141900.290265:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1869759521088640:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1783141900.290400:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1783141900.290439:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bf14380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1869759521088768:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783141900.290482:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141900.290498:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141900.290570:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521088768 00000100:00100000:2.0:1783141900.290574:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521088768 00000100:00100000:2.0:1783141900.290598:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783141900.290603:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7934:x1869759521088768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783141900.290683:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7934:x1869759521088768:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (200us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783141900.290689:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783141900.290720:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bf14380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7934:1869759521088768:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783141900.290745:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290753:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290759:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290764:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cdc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.290768:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290774:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290784:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:2.0:1783141900.290787:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141900.290790:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290806:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380742b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290832:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290838:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290842:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290846:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ec00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.290850:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290855:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290863:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:2.0:1783141900.290866:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141900.290868:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290873:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807359 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290909:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290922:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 17 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290937:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290960:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 17 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.290972:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 17 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.290983:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bf16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088896:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141900.291043:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b601180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141900.294110:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bf16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521088896:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141900.294138:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.295391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.295574:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501090816 00000100:00100000:3.0:1783141900.295583:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501090816 00010000:00010000:3.0:1783141900.295619:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 18 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141900.295657:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:3.0:1783141900.295666:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2402:x1869759501090816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141900.295679:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141900.295686:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 18 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295696:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 18 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295725:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807375 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e6c8 expref: 18 pid: 11334 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295738:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:3.0:1783141900.295742:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295751:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295758:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.295786:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141900.295829:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:2402:x1869759501090816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.295837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00010000:00010000:2.0:1783141900.296121:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296130:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296143:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296149:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296156:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296170:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.296175:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296182:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296191:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:2.0:1783141900.296194:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141900.296198:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296204:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807432 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296223:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296228:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296233:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296237:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.296240:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296245:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296262:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c4e71a900) 00010000:00010000:2.0:1783141900.296264:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141900.296267:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.296829:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807424 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.297002:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11303:x1869759501090432:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 31561us (31794us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1783141900.297013:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 93 00000020:00080000:2.0:1783141900.297018:0:7934:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783141900.297142:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141900.297147:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141900.297162:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783141900.297168:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141900.303404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.305309:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091072 00000100:00100000:0.0:1783141900.305322:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091072 00000100:00100000:0.0:1783141900.305762:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783141900.305776:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11303:x1869759501091072:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783141900.306254:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783141900.306333:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:0.0:1783141900.306375:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306611:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306623:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306632:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306639:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306644:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.306656:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783141900.306784:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:11303:x1869759501091072:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 1010us (3386us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783141900.306794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000020:00080000:0.0:1783141900.306799:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141900.307070:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141900.307076:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.307084:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783141900.307087:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.307094:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.307107:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:1.0:1783141900.307110:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783141900.307115:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.307121:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807439 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.307133:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141900.307135:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141900.307143:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141900.548869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.548914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.548941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.548967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.548983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.548998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.549047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091200 00000100:00100000:0.0:1783141900.549062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091200 00000100:00100000:0.0:1783141900.549108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 374 00000100:00100000:0.0:1783141900.549116:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501091200:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141900.550387:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c614e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501091200:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1265us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.550396:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 374 00000100:00100000:0.0:1783141900.550439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091456 00000100:00100000:0.0:1783141900.550445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091456 00000100:00100000:0.0:1783141900.550484:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091968 00000100:00100000:0.0:1783141900.550487:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091968 00000100:00100000:0.0:1783141900.550505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091328 00000100:00100000:0.0:1783141900.550507:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091328 00000100:00100000:0.0:1783141900.550522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00100000:0.0:1783141900.550528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501091456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.550882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.550900:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091840 00000100:00100000:3.0:1783141900.550904:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091840 00000100:00100000:3.0:1783141900.550928:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:3.0:1783141900.550936:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501091968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.550993:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501091968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 57us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.550993:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501091456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 464us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.551000:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:3.0:1783141900.551015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:3.0:1783141900.551021:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2401:x1869759501091328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.551076:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2401:x1869759501091328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 54us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.551082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:3.0:1783141900.551094:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:1.0:1783141900.551095:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091712 00000100:00100000:1.0:1783141900.551099:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091712 00000100:00100000:3.0:1783141900.551100:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501091840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.551122:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501091840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.551126:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501091584 00000100:00100000:1.0:1783141900.551128:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501091584 00000100:00100000:3.0:1783141900.551129:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:1.0:1783141900.551145:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:3.0:1783141900.551161:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:1.0:1783141900.551161:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501091712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.551166:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501091584:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141900.551188:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501091584:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.551188:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501091712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.551195:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:1.0:1783141900.551305:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:3.0:1783141900.551510:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141900.551523:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521089024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141900.551562:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141900.551622:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089024 00000100:00100000:3.0:1783141900.551626:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089024 00000100:00100000:3.0:1783141900.551650:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783141900.551661:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521089024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141900.551685:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141900.551721:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521089024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.551727:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783141900.551763:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521089024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141900.552269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00080000:0.0:1783141900.552327:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141900.552331:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141900.552334:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783141900.689430:0:14210:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141900.689438:0:14210:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783141900.689460:0:14210:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783141900.689466:0:14210:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141900.775806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.776037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501092224 00000100:00100000:2.0:1783141900.776047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501092224 00000100:00100000:2.0:1783141900.776108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:2.0:1783141900.776117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:11313:x1869759501092224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141900.776140:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141900.776189:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e700 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.776310:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3807447 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.776324:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3807447 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.776335:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3807447 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141900.776346:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783141900.776451:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e700 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.776470:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3807447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e700 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.776537:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141900.776540:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141900.776550:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd000, rc 0) 00000100:00100000:3.0:1783141900.776615:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:11313:x1869759501092224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 498us (816us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783141900.776623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:2.0:1783141900.780246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.781181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501092352 00000100:00100000:0.0:1783141900.781193:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501092352 00000100:00100000:0.0:1783141900.781250:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:0.0:1783141900.781260:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:11313:x1869759501092352:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1783141900.781364:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781382:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781393:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781409:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781423:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781497:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781504:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781510:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141900.781556:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781568:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781585:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781590:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781596:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.781600:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781606:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781618:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141900.781621:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.781626:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781632:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807455 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781644:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781651:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781657:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781663:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.781673:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781679:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781688:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141900.781690:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.781693:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781698:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380745c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781714:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781719:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781724:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781729:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.781733:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781739:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781747:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141900.781750:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.781765:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.781770:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807463 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.781847:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:11313:x1869759501092352:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 587us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.781856:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:2.0:1783141900.825514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.825680:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501092608 00000100:00100000:0.0:1783141900.825690:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501092608 00000100:00100000:0.0:1783141900.825750:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:0.0:1783141900.825760:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:11316:x1869759501092608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141900.825780:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.825798:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a380746a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e707 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.825945:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.825959:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.825970:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.825984:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.825992:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826015:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826136:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826144:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826151:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141900.826161:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783141900.826231:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826239:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826245:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826251:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.826254:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826260:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826358:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141900.826363:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.826374:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826381:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807471 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826393:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826400:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826405:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826411:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141900.826413:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826419:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826427:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141900.826430:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141900.826432:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826438:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807478 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826480:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a380746a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 23 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826506:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 22 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.826513:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141900.826515:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141900.826517:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ea00, rc 0) 00000100:00100000:0.0:1783141900.826680:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11316:x1869759501092608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 920us (1174us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1783141900.826689:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:0.0:1783141900.831907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141900.831977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501092736 00000100:00100000:3.0:1783141900.831988:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501092736 00000100:00100000:3.0:1783141900.832055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:3.0:1783141900.832065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11316:x1869759501092736:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783141900.832140:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832158:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832169:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832205:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832212:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832219:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832225:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141900.832230:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832238:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832264:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141900.832267:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141900.832306:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.832314:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380748d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141900.832409:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11316:x1869759501092736:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 345us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141900.832418:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:2.0:1783141900.834806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.836513:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501092992 00000100:00100000:1.0:1783141900.836526:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501092992 00000100:00100000:1.0:1783141900.836689:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1783141900.836700:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11316:x1869759501092992:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783141900.836948:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:11316:x1869759501092992:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 249us (2149us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1783141900.836955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1783141900.872402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.873165:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501093248 00000100:00100000:1.0:1783141900.873177:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501093248 00000100:00100000:1.0:1783141900.873249:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:1.0:1783141900.873259:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:10844:x1869759501093248:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141900.873302:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141900.873323:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807494 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e70e expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.873422:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.873451:0:11334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 24 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.873460:0:11334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.873491:0:11334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 24 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.873506:0:11334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 24 pid: 7934 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141900.873519:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521089152:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141900.873619:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141900.878714:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521089152:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141900.878746:0:11334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.886990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.888473:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501093376 00000100:00100000:0.0:1783141900.888486:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501093376 00010000:00010000:0.0:1783141900.888529:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 25 pid: 7934 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141900.888624:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:0.0:1783141900.888635:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:2403:x1869759501093376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141900.888651:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141900.888658:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 25 pid: 7934 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888672:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 25 pid: 7934 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888692:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a380747f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e707 expref: 25 pid: 7934 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888736:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141900.888742:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888750:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888758:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.888780:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141900.888854:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:2403:x1869759501093376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 220us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.888862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00010000:00010000:1.0:1783141900.890700:0:11334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.890715:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141900.890738:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783141900.891119:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807494 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 25 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.891160:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 24 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.891168:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141900.891171:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783141900.891174:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3e00, rc 0) 00000100:00100000:1.0:1783141900.891363:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:10844:x1869759501093248:12345-192.168.203.39@tcp:101:bash.0 Request processed in 18102us (18967us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783141900.891372:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:2.0:1783141900.894185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.895164:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501093504 00000100:00100000:0.0:1783141900.895175:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501093504 00000100:00100000:0.0:1783141900.895312:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:0.0:1783141900.895323:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:10844:x1869759501093504:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141900.895347:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141900.895366:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38074a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e715 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895400:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38074b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895414:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38074b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895443:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38074b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895551:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38074a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e715 expref: 26 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895569:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38074b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e715 expref: 25 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.895577:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141900.895580:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141900.895583:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:0.0:1783141900.895648:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:10844:x1869759501093504:12345-192.168.203.39@tcp:101:bash.0 Request processed in 328us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141900.895656:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:3.0:1783141900.905566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141900.908387:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501093760 00000100:00100000:0.0:1783141900.908402:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501093760 00000100:00100000:0.0:1783141900.908591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:0.0:1783141900.908603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:10844:x1869759501093760:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:0.0:1783141900.908939:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.908958:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.908969:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141900.909040:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:0.0:1783141900.909066:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a616cb5 reply state 00000000b4283276 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.909079:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141900.909087:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141900.909089:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141900.909093:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783141900.909133:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1783141900.909399:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:10844:x1869759501093760:12345-192.168.203.39@tcp:36:bash.0 Request processed in 797us (3838us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783141900.909407:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00000020:00080000:0.0:1783141900.909413:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783141900.912997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.913121:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501093888 00000100:00100000:1.0:1783141900.913131:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501093888 00000100:00100000:1.0:1783141900.913188:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:1.0:1783141900.913199:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:10844:x1869759501093888:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141900.913220:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141900.913240:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38074be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e71c expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.913332:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38074be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e71c expref: 30 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.913347:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38074be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e71c expref: 30 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.913366:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141900.913369:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141900.913397:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:1.0:1783141900.913450:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:10844:x1869759501093888:12345-192.168.203.39@tcp:101:bash.0 Request processed in 253us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.913457:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:2.0:1783141900.916236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141900.916669:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094016 00000100:00100000:1.0:1783141900.916679:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094016 00000100:00100000:1.0:1783141900.916736:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:1.0:1783141900.916743:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:10844:x1869759501094016:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141900.916760:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141900.916779:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e723 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141900.916803:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a48960c, atime: 0x6a48960a, ctime: 0x6a48960c, blocks: 0x8 00010000:00010000:1.0:1783141900.916822:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1783141900.916826:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141900.916834:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.916849:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.916862:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3200, rc 0) 00000100:00100000:1.0:1783141900.916964:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:10844:x1869759501094016:12345-192.168.203.39@tcp:101:bash.0 Request processed in 220us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141900.916971:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783141900.919349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.919422:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094144 00000100:00100000:2.0:1783141900.919430:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094144 00002000:00010000:2.0:1783141900.919471:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1783141900.919497:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b437cb480 with x1869759501094144 ext(0->18446744073709551615) 00002000:00010000:2.0:1783141900.919508:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b437cb480. 00000100:00100000:2.0:1783141900.919545:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:2.0:1783141900.919555:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501094144:12345-192.168.203.39@tcp:10:bash.0 00002000:00010000:2.0:1783141900.919796:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783141900.919799:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783141900 -> 1783141901 00002000:00010000:2.0:1783141900.919802:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783141898 -> 1783141898 00002000:00010000:2.0:1783141900.919804:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783141900 -> 1783141901 00002000:00010000:2.0:1783141900.919806:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783141900.919858:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501094144:12345-192.168.203.39@tcp:10:bash.0 Request processed in 304us (517us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783141900.919866:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00002000:00010000:2.0:1783141900.919870:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1783141900.919872:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b437cb480 with x1869759501094144 ext(0->18446744073709551615) 00002000:00010000:2.0:1783141900.919877:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b437cb480. 00000100:00100000:0.0:1783141900.990666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141900.990770:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094272 00000100:00100000:2.0:1783141900.990781:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094272 00000100:00100000:2.0:1783141900.990843:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:2.0:1783141900.990852:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11330:x1869759501094272:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783141900.990935:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.990953:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.990965:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991010:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991019:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991035:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991107:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991118:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991125:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141900.991168:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991180:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991186:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991192:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991198:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.991202:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991215:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991226:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141900.991229:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141900.991233:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991239:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38074cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991261:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991268:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991329:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991334:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.991337:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991344:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991352:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b42686100) 00010000:00010000:2.0:1783141900.991354:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141900.991358:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991385:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38074d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991404:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991410:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991415:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991420:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141900.991423:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991428:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991437:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141900.991439:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141900.991442:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.991447:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38074da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141900.991529:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11330:x1869759501094272:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 676us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141900.991537:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00000040:00080000:3.0:1783141900.997016:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783141901.053843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.053908:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094528 00000100:00100000:0.0:1783141901.053918:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094528 00000100:00100000:0.0:1783141901.053998:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:0.0:1783141901.054009:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11333:x1869759501094528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141901.054037:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.054057:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38074e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e72a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054142:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054156:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054180:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054195:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054203:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054210:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054343:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38074f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054351:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38074f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054358:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38074f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141901.054368:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141901.054438:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054445:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054452:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054457:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141901.054467:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054659:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054741:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141901.054746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141901.054750:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054756:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a38074e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054770:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054776:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054782:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054787:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141901.054790:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054796:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054805:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.054807:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141901.054816:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054823:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38074ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054865:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a38074e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e72a expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054879:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38074f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e72a expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.054886:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141901.054889:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783141901.054891:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f800, rc 0) 00000100:00080000:3.0:1783141901.055006:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141901.055054:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11333:x1869759501094528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1047us (1220us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783141901.055062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:0.0:1783141901.060506:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141901.060530:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521089280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141901.060616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.060873:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089280 00000100:00100000:1.0:1783141901.060887:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089280 00000100:00100000:1.0:1783141901.060953:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783141901.060963:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521089280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141901.060994:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141901.061050:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521089280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.061058:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1783141901.061196:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141901.061222:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521089408:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.061466:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521089792:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061560:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521089536:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141901.061609:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521090048:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141901.061646:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521090560:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141901.061696:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141901.061702:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521089920:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141901.061742:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521090432:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061764:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141901.061790:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089920 00000100:00100000:2.0:1783141901.061794:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089920 00000100:00100000:2.0:1783141901.061822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783141901.061830:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521089920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061869:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521089920:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.061875:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783141901.061895:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090432 00000100:00100000:2.0:1783141901.061897:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090432 00000100:00100000:2.0:1783141901.061918:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783141901.061924:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521090432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.061952:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521090432:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.061964:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783141901.061984:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089536 00000100:00100000:2.0:1783141901.061987:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089536 00000100:00100000:2.0:1783141901.062008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090048 00000100:00100000:2.0:1783141901.062011:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090048 00000100:00100000:2.0:1783141901.062043:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090560 00000100:00100000:2.0:1783141901.062047:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090560 00000100:00100000:2.0:1783141901.062062:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141901.062068:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062098:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521089536:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.062104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141901.062129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141901.062135:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521090048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062160:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521090048:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.062165:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141901.062176:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783141901.062181:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062205:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521090560:12345-0@lo:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.062211:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1783141901.062226:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141901.062252:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521089920:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062263:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521090432:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062292:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521089536:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062310:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521090048:0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.062319:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521090560:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062730:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521090304:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062757:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062776:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521090816:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062795:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062813:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783141901.062820:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521089664:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062856:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521090176:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062891:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521090688:0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.062911:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.062936:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090304 00000100:00100000:1.0:1783141901.062941:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090304 00000100:00100000:1.0:1783141901.062974:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090816 00000100:00100000:1.0:1783141901.062978:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090816 00000100:00100000:1.0:1783141901.062992:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783141901.062998:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521090304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141901.063061:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521090304:12345-0@lo:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.063069:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783141901.063082:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783141901.063088:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521090816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141901.063229:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521089280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783141901.063264:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089792 00000100:00100000:0.0:1783141901.063268:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089792 00000100:00100000:0.0:1783141901.063308:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090176 00000100:00100000:0.0:1783141901.063311:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090176 00000100:00100000:0.0:1783141901.063321:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090688 00000100:00100000:0.0:1783141901.063323:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090688 00000100:00100000:0.0:1783141901.063336:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783141901.063350:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521089792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141901.063384:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521089792:12345-0@lo:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.063390:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783141901.063402:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783141901.063408:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521090176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141901.063433:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521090176:12345-0@lo:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.063439:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783141901.063449:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783141901.063455:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521090688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.063808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089408 00000100:00100000:3.0:1783141901.063812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089408 00000100:00100000:3.0:1783141901.063839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1783141901.063845:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141901.067428:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521089664 00000100:00100000:2.0:1783141901.067442:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521089664 00000100:00100000:2.0:1783141901.067510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783141901.067520:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.067780:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521089408:12345-0@lo:400:kworker.0 Request processed in 3932us (6517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.067790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1783141901.067843:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521090944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141901.067898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141901.067942:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521089408:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.067977:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521090944 00000100:00100000:3.0:1783141901.067986:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521090944 00000100:00100000:3.0:1783141901.068018:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783141901.068035:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3652:x1869759521090944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141901.068051:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141901.068089:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3652:x1869759521090944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.068095:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783141901.068138:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b437c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521090944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783141901.068198:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141901.068203:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141901.068230:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43577800 x1869759521090176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141901.068240:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521090176:0@lo:400:kworker.0 00010000:00080000:3.0:1783141901.068253:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f80d880 x1869759521090688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141901.068261:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521090688:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.068290:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521089792:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.068304:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521090304:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.068314:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521090816:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.068386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.068418:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094656 00000100:00100000:3.0:1783141901.068422:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094656 00000100:00100000:3.0:1783141901.068451:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:3.0:1783141901.068458:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11333:x1869759501094656:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783141901.068518:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.068534:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 32 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.068543:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.068573:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 32 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.068586:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 32 pid: 11334 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.068598:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521091072:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141901.068659:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141901.069780:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f832a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521091072:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141901.069801:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.069804:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521090688:12345-0@lo:400:kworker.0 Request processed in 6347us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.069814:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783141901.070405:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521090816:12345-0@lo:400:kworker.0 Request processed in 7314us (7606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.070416:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783141901.071466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.071577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501094912 00000100:00100000:0.0:1783141901.071585:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501094912 00000100:00100000:0.0:1783141901.071635:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783141901.071644:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:6169:x1869759501094912:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783141901.071929:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:6169:x1869759501094912:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 284us (466us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783141901.071937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1783141901.073126:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521089664:12345-0@lo:400:kworker.0 Request processed in 5592us (10267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.073139:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783141901.073268:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521089664:0@lo:400:kworker.0 00000100:00100000:3.0:1783141901.074575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.074781:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501095040 00000100:00100000:1.0:1783141901.074791:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501095040 00010000:00010000:1.0:1783141901.074828:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 34 pid: 11334 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.074870:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1783141901.074878:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:2403:x1869759501095040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141901.074892:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141901.074898:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 34 pid: 11334 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.074910:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 34 pid: 11334 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.074930:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a380749b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e70e expref: 34 pid: 11334 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.074947:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141901.074959:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.074968:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.074975:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.075013:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141901.075078:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:2403:x1869759501095040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.075085:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00010000:00010000:2.0:1783141901.075305:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075315:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075354:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075362:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075369:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075375:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141901.075380:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075387:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075406:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141901.075408:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141901.075412:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.075418:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141901.075463:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11333:x1869759501094656:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 7004us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.075472:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:3.0:1783141901.080862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.080954:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501095296 00000100:00100000:0.0:1783141901.080965:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501095296 00000100:00100000:0.0:1783141901.081035:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1783141901.081044:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:11333:x1869759501095296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141901.083269:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:11333:x1869759501095296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 2217us (2408us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1783141901.083295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1783141901.163019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.163134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501095552 00000100:00100000:3.0:1783141901.163154:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501095552 00000100:00100000:3.0:1783141901.163234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:3.0:1783141901.163255:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+33:11345:x1869759501095552:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783141901.163331:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.163351:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a380750b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e731 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163430:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163444:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163455:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163469:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163476:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163482:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163590:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163599:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163606:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141901.163628:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1783141901.163706:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163713:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163720:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163726:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cca00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.163731:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163738:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163750:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141901.163753:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141901.163759:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163765:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163778:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163784:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163799:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163804:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.163807:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163813:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163821:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:3.0:1783141901.163823:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141901.163826:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163831:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a3807519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163871:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a380750b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e731 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163884:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e731 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.163891:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141901.163894:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141901.163896:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cdc00, rc 0) 00000100:00100000:3.0:1783141901.163950:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11345:x1869759501095552:12345-192.168.203.39@tcp:101:cat.0 Request processed in 707us (939us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1783141901.163965:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:3.0:1783141901.167813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.169532:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501095808 00000100:00100000:1.0:1783141901.169546:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501095808 00000100:00100000:1.0:1783141901.169607:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:1.0:1783141901.169617:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11345:x1869759501095808:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:1.0:1783141901.169916:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:11345:x1869759501095808:12345-192.168.203.39@tcp:35:cat.0 Request processed in 299us (2111us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783141901.169925:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00010000:00010000:0.0:1783141901.188934:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141901.196976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.197109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096064 00000100:00100000:3.0:1783141901.197119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096064 00000100:00100000:3.0:1783141901.197218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:3.0:1783141901.197229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:11346:x1869759501096064:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1783141901.197596:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1783141901.197624:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38074be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e71c expref: 36 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197647:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807520 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e731 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38074f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e72a expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38074b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e715 expref: 33 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197682:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141901.197686:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141901.197707:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197721:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197730:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197760:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197769:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197775:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197850:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197859:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.197866:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141901.198344:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1783141901.198356:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412265083607ns, next at 413265080540ns, rc = 0 00010000:00010000:3.0:1783141901.198409:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198418:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198426:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198434:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198451:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198457:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198483:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783141901.198503:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198509:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198515:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198521:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.198525:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198533:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198543:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141901.198545:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783141901.198549:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198554:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380753c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198569:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198580:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198587:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198592:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.198595:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198601:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198608:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141901.198610:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141901.198613:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198619:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380752e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141901.198629:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014683615 reply state 000000006e79fc74 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198639:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.198645:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:3.0:1783141901.198647:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141901.198649:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141901.198730:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:11346:x1869759501096064:12345-192.168.203.39@tcp:36:rm.0 Request processed in 1502us (1761us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1783141901.198744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 106 00010000:00010000:1.0:1783141901.199302:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141901.199310:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.199317:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cca00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783141901.199320:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.199327:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.199348:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141901.199351:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783141901.199355:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.199360:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807543 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.199371:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141901.199373:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141901.199385:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141901.251556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.254044:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096320 00000100:00100000:2.0:1783141901.254060:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096320 00000100:00100000:2.0:1783141901.254149:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:2.0:1783141901.254159:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:11352:x1869759501096320:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141901.254184:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141901.254205:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380754a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e738 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254688:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254703:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254714:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254724:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254746:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.254753:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141901.255148:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783141901.255304:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255314:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255322:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255352:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255359:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255365:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255371:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141901.255375:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255383:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255469:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141901.255472:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141901.255478:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255484:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807551 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141901.255498:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000854aff30 reply state 00000000f07026ea transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255509:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255515:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:2.0:1783141901.255517:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783141901.255521:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783141901.255552:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380754a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255565:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 36 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.255573:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:2.0:1783141901.255575:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141901.255577:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:2.0:1783141901.255699:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:11352:x1869759501096320:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1542us (4161us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783141901.255708:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:0.0:1783141901.260951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.264566:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096448 00000100:00100000:1.0:1783141901.264581:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096448 00000100:00100000:1.0:1783141901.264716:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:1.0:1783141901.264727:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501096448:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141901.264744:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141901.264763:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e73f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141901.264798:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783141901.264816:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1783141901.264820:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141901.264828:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.264846:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.264879:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3e00, rc 0) 00000100:00100000:1.0:1783141901.264954:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501096448:12345-192.168.203.39@tcp:101:bash.0 Request processed in 228us (4011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.264960:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783141901.276419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.276513:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096576 00000100:00100000:3.0:1783141901.276523:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096576 00000100:00100000:3.0:1783141901.276576:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:3.0:1783141901.276585:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:11352:x1869759501096576:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141901.276603:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.276621:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e746 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.276653:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.276661:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141901.276664:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141901.276669:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.276702:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.276713:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.276727:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f833800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521091200:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141901.277192:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141901.281159:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f833800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521091200:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141901.281308:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.281330:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd600, rc 0) 00000100:00100000:3.0:1783141901.281393:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:11352:x1869759501096576:12345-192.168.203.39@tcp:101:bash.0 Request processed in 4808us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.281402:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1783141901.287824:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.288821:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096704 00000100:00100000:1.0:1783141901.288832:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096704 00010000:00010000:2.0:1783141901.288978:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141901.289037:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783141901.289047:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501096704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141901.289061:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141901.289086:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.289101:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.289126:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a380756d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e73f expref: 9 pid: 8438 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.289144:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141901.289148:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141901.289156:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.289166:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.289204:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141901.289235:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f855500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1869759521091328:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783141901.289479:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141901.294709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.294801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501096960 00000100:00100000:1.0:1783141901.294810:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501096960 00000100:00100000:1.0:1783141901.294867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:1.0:1783141901.294877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:11352:x1869759501096960:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:1.0:1783141901.295165:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11352:x1869759501096960:12345-192.168.203.39@tcp:35:bash.0 Request processed in 287us (464us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1783141901.295172:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1783141901.295730:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f855500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1869759521091328:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783141901.295751:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141901.295798:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501096704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6752us (7982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.295806:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1783141901.510487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.512030:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097088 00000100:00100000:2.0:1783141901.512044:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097088 00000100:00100000:2.0:1783141901.512115:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:2.0:1783141901.512124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:11368:x1869759501097088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141901.512151:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141901.512170:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380757b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e74d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512234:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512248:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512259:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141901.512335:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783141901.512339:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141901.512373:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512399:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380757b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e74d expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512419:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e74d expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.512427:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141901.512430:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141901.512433:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0000, rc 0) 00000100:00100000:2.0:1783141901.512502:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:11368:x1869759501097088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 378us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.512509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:3.0:1783141901.523812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.525312:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097344 00000100:00100000:2.0:1783141901.525325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097344 00000100:00100000:2.0:1783141901.525397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:2.0:1783141901.525407:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:11368:x1869759501097344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141901.525426:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141901.525445:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e754 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.525560:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.525575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.525586:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141901.525611:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783141901.525713:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e754 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.525732:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e754 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.525740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:2.0:1783141901.525743:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141901.525746:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783141901.525818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:11368:x1869759501097344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 413us (2016us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1783141901.525826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:3.0:1783141901.529404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.529515:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097600 00000100:00100000:2.0:1783141901.529527:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097600 00000100:00100000:3.0:1783141901.529644:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00100000:3.0:1783141901.529654:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:11368:x1869759501097600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141901.529676:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.529694:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380759e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e75b expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.529806:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.529821:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.529832:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141901.529845:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783141901.529941:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380759e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e75b expref: 44 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.530137:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e75b expref: 43 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.530146:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:3.0:1783141901.530149:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783141901.530152:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc600, rc 0) 00000100:00100000:3.0:1783141901.530209:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:11368:x1869759501097600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 556us (813us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1783141901.530217:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00100000:0.0:1783141901.531111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.531184:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097728 00000100:00100000:2.0:1783141901.531191:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097728 00000100:00100000:2.0:1783141901.531243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783141901.531252:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:2400:x1869759501097728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141901.531266:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141901.531329:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e754 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.531345:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:2.0:1783141901.531350:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141901.531389:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:2400:x1869759501097728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 138us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.531408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783141901.539458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.539586:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097856 00000100:00100000:3.0:1783141901.539595:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097856 00000100:00100000:3.0:1783141901.539650:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783141901.539660:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501097856:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1783141901.539705:0:8865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.539722:0:8865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.539730:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141901.539734:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141901.539739:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.539772:0:8865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.539984:0:8865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 8 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.539999:0:8865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8865:1869759521091456:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141901.540637:0:8865:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141901.541662:0:8865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8865:1869759521091456:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141901.541687:0:8865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.547264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.547394:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501097984 00000100:00100000:1.0:1783141901.547404:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501097984 00002000:00100000:1.0:1783141901.547450:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f9c6f909500 x1869759501097984/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:277/0 lens 504/0 e 0 to 0 dl 1783141912 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141901.547462:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f909500 with x1869759501097984 ext(0->8) 00010000:00010000:1.0:1783141901.547472:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 9 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.547490:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 9 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141901.547498:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9c6f909500 00000100:00100000:1.0:1783141901.547545:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:1.0:1783141901.547554:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501097984:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1783141901.549266:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2402:x1869759501097984:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 1704us (2002us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783141901.549304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00002000:00100000:1.0:1783141901.549316:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f9c6f909500 x1869759501097984/t4294967303(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:277/0 lens 504/448 e 0 to 0 dl 1783141912 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141901.549330:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f909500 with x1869759501097984 ext(0->8) 00010000:00010000:1.0:1783141901.549339:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.549356:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141901.549364:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9c6f909500 00000100:00100000:3.0:1783141901.552164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.552300:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501098112 00000100:00100000:1.0:1783141901.552310:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501098112 00010000:00010000:1.0:1783141901.552346:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.552394:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:1.0:1783141901.552403:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2401:x1869759501098112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141901.552417:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783141901.552433:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783141901.552436:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783141901 00002000:00010000:1.0:1783141901.552447:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783141902 00002000:00010000:1.0:1783141901.552449:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783141901 00002000:00010000:1.0:1783141901.552451:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783141901.552458:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.553103:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.553128:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061464e23/0xb31399d6a3807574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e746 expref: 11 pid: 8439 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.553145:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141901.553149:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141901.553154:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.553165:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.553208:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141901.553265:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49a38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2401:x1869759501098112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 862us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.553306:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00010000:00010000:0.0:1783141901.553569:0:8865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553581:0:8865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553602:0:8865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553622:0:8865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553631:0:8865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553638:0:8865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141901.553642:0:8865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553651:0:8865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553662:0:8865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.553669:0:8865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a38075b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.553718:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501097856:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 14060us (14270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.553725:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783141901.558971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.559142:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501098368 00000100:00100000:1.0:1783141901.559153:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501098368 00000100:00100000:1.0:1783141901.559216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1783141901.559227:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:11368:x1869759501098368:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1783141901.559341:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e75b expref: 42 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141901.561175:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1783141901.561227:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1783141901.561592:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:1.0:1783141901.561641:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.561660:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 46 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.561669:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.561709:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 46 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.561725:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 46 pid: 7934 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.561739:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521091584:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141901.562102:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141901.565168:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521091584:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141901.565267:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.570554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.570770:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501098496 00000100:00100000:2.0:1783141901.570780:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501098496 00010000:00010000:2.0:1783141901.570836:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 47 pid: 7934 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141901.570934:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:2.0:1783141901.570945:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:2402:x1869759501098496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141901.570968:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141901.570976:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 47 pid: 7934 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.570990:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 47 pid: 7934 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.571011:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a380755f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e738 expref: 47 pid: 7934 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.571039:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:2.0:1783141901.571045:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.571055:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.571062:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.571108:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141901.571161:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+46:2402:x1869759501098496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 218us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.571170:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00010000:00010000:1.0:1783141901.571306:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.571324:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141901.572507:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:1.0:1783141901.572632:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1783141901.572721:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521091712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783141901.572780:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.572806:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141901.573673:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521091712 00000100:00100000:3.0:1783141901.573683:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521091712 00000100:00100000:3.0:1783141901.573737:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141901.573747:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521091712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783141901.573843:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521091712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.573850:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783141901.574337:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521091712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783141901.576405:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1783141901.576487:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521091840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783141901.576545:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.576582:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141901.576992:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521091840 00000100:00100000:3.0:1783141901.577000:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521091840 00000100:00100000:3.0:1783141901.577064:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783141901.577074:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521091840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783141901.577218:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1869759521091840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 145us (672us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783141901.577226:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783141901.578170:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521091840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783141901.578320:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1783141901.578365:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578375:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578383:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578389:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141901.578393:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578417:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578433:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:1.0:1783141901.578436:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783141901.578441:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.578447:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38075ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141901.578547:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783141901.578608:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1783141901.578622:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412645348919ns, next at 413645346721ns, rc = 0 00000001:00080000:1.0:1783141901.578628:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1783141901.578652:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9b42686100) 00010000:00010000:1.0:1783141901.578655:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783141901.578663:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38075a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e75b expref: 50 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.578763:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:11368:x1869759501098368:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 19538us (19800us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783141901.578773:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000020:00080000:1.0:1783141901.578777:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783141901.582649:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521091968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141901.582722:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141901.582824:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521091968 00000100:00100000:1.0:1783141901.582832:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521091968 00000100:00100000:1.0:1783141901.582873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783141901.582881:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521091968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141901.582935:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783141901.582980:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521091968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.582987:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783141901.583136:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521091968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141901.583775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.584001:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501098624 00000100:00100000:0.0:1783141901.584006:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501098624 00000100:00100000:0.0:1783141901.584058:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:0.0:1783141901.584074:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:11368:x1869759501098624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141901.584101:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.584211:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38075c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e762 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.584388:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38075c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e762 expref: 50 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.584402:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38075c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e762 expref: 50 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.584420:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.584423:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141901.584426:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f200, rc 0) 00000100:00100000:0.0:1783141901.584482:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:11368:x1869759501098624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 407us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.584490:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:3.0:1783141901.590265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.590374:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501098880 00000100:00100000:0.0:1783141901.590382:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501098880 00000100:00100000:0.0:1783141901.590440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783141901.590461:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:11368:x1869759501098880:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141901.591055:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:11368:x1869759501098880:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 595us (797us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783141901.591065:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:3.0:1783141901.684359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.684592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501099008 00000100:00100000:0.0:1783141901.684602:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501099008 00000100:00100000:0.0:1783141901.684684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:0.0:1783141901.684704:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:11378:x1869759501099008:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1783141901.684784:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684801:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684812:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684822:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684829:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684835:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684914:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684922:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684928:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141901.684983:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.684995:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685006:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685013:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685028:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141901.685032:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685039:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685051:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141901.685054:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141901.685058:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685064:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a38075c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685077:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685083:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685088:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685093:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141901.685101:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685107:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685114:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:0.0:1783141901.685116:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141901.685118:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685124:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a38075cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685132:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685137:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685142:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685146:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ec00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141901.685149:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685154:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685160:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.685162:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141901.685168:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.685174:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a38075d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.685364:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:11378:x1869759501099008:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 659us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.685372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:3.0:1783141901.734802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.734910:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501099264 00000100:00100000:2.0:1783141901.734920:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501099264 00000100:00100000:2.0:1783141901.734981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:2.0:1783141901.734991:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:11381:x1869759501099264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141901.735012:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141901.735042:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38075dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e769 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735126:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735137:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735149:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735169:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735177:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735330:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735339:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735346:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141901.735357:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783141901.735441:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735449:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735455:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735461:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141901.735477:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735485:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735498:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141901.735501:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141901.735506:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735522:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38075e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735537:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735543:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735549:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735554:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141901.735557:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735568:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735575:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:2.0:1783141901.735578:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141901.735581:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735587:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38075eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735621:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38075dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735633:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 53 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.735646:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141901.735648:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141901.735651:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783141901.735714:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11381:x1869759501099264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 725us (921us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1783141901.735722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:1.0:1783141901.738948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.739075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501099392 00000100:00100000:2.0:1783141901.739085:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501099392 00000100:00100000:2.0:1783141901.739142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:2.0:1783141901.739152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11381:x1869759501099392:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783141901.739373:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739434:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739442:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739449:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739455:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141901.739535:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739545:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739558:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141901.739561:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141901.739566:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.739573:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807600 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141901.739695:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11381:x1869759501099392:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 544us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.739704:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:0.0:1783141901.742321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.742389:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501099648 00000100:00100000:1.0:1783141901.742399:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501099648 00000100:00100000:1.0:1783141901.742446:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783141901.742455:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:11381:x1869759501099648:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783141901.742698:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11381:x1869759501099648:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 243us (385us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783141901.742706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:3.0:1783141901.797596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.797891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501099904 00000100:00100000:0.0:1783141901.797901:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501099904 00000100:00100000:0.0:1783141901.797964:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:0.0:1783141901.797974:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11391:x1869759501099904:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141901.797999:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.798002:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141901.798038:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807582 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e74d expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798058:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141901.798062:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141901.798074:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807607 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e770 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798610:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798625:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798652:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798684:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.798696:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 54 pid: 6524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.798709:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092096:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141901.798806:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bd31d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141901.802384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.802413:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092096:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141901.802440:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.802554:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100032 00000100:00100000:1.0:1783141901.802562:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100032 00010000:00010000:1.0:1783141901.802596:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 55 pid: 6524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.802634:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:1.0:1783141901.802643:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:2402:x1869759501100032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141901.802657:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141901.802663:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 55 pid: 6524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802674:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 55 pid: 6524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802712:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38075f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e769 expref: 55 pid: 6524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802734:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:1.0:1783141901.802738:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802747:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802812:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.802839:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141901.802886:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:2402:x1869759501100032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 244us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.802894:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00010000:00010000:0.0:1783141901.803095:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.803103:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141901.803121:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783141901.803249:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807607 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.803309:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.803326:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.803329:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141901.803331:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141901.803363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11391:x1869759501099904:12345-192.168.203.39@tcp:101:bash.0 Request processed in 5391us (5776us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1783141901.803369:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:3.0:1783141901.807367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.807449:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100160 00000100:00100000:0.0:1783141901.807459:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100160 00000100:00100000:0.0:1783141901.807523:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:0.0:1783141901.807532:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:11391:x1869759501100160:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141901.807556:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.807575:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a380761c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e777 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807610:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807622:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807633:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807745:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a380761c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 56 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807763:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 55 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.807780:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.807783:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141901.807787:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fc00, rc 0) 00000100:00100000:0.0:1783141901.807834:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:11391:x1869759501100160:12345-192.168.203.39@tcp:101:bash.0 Request processed in 303us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.807841:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1783141901.812396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.813043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100416 00000100:00100000:2.0:1783141901.813054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100416 00000100:00100000:2.0:1783141901.813197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:2.0:1783141901.813207:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:11391:x1869759501100416:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:2.0:1783141901.813442:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.813459:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.813470:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141901.813511:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1783141901.813546:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8357825 reply state 00000000142fc74f transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.813560:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.813568:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141901.813571:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783141901.813574:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141901.813666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:11391:x1869759501100416:12345-192.168.203.39@tcp:36:bash.0 Request processed in 460us (1278us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783141901.813675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000020:00080000:2.0:1783141901.813679:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783141901.817427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.817563:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100544 00000100:00100000:0.0:1783141901.817572:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100544 00000100:00100000:0.0:1783141901.817653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:0.0:1783141901.817662:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:11391:x1869759501100544:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141901.817684:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.817703:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807631 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e77e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.817782:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.817795:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.817802:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.817831:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.817842:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 59 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.817867:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092224:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141901.817994:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bd31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141901.820444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.820556:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100672 00000100:00100000:3.0:1783141901.820564:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100672 00010000:00010000:3.0:1783141901.820598:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 60 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.820637:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:3.0:1783141901.820645:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:2403:x1869759501100672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141901.820658:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141901.820664:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 60 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.820677:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 60 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.820696:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141901.820701:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.820710:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.820743:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.820760:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141901.820809:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:2403:x1869759501100672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.820816:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00010000:00010000:0.0:1783141901.822015:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a380760e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e770 expref: 59 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.822043:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092224:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141901.822065:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.822073:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.822078:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141901.822173:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783141901.822177:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141901.822196:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.822226:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.822239:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.822246:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141901.822259:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141901.822262:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ec00, rc 0) 00000100:00100000:0.0:1783141901.822381:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:11391:x1869759501100544:12345-192.168.203.39@tcp:101:bash.0 Request processed in 4719us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141901.822389:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:1.0:1783141901.825001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141901.825084:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501100928 00000100:00100000:0.0:1783141901.825093:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501100928 00000100:00100000:0.0:1783141901.825144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783141901.825153:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:11391:x1869759501100928:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783141901.825415:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11391:x1869759501100928:12345-192.168.203.39@tcp:35:bash.0 Request processed in 261us (419us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783141901.825422:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:1.0:1783141901.890810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.890936:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101056 00000100:00100000:3.0:1783141901.890945:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101056 00000100:00100000:3.0:1783141901.891075:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:3.0:1783141901.891086:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:11397:x1869759501101056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141901.891108:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.891129:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380763f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e785 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891194:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891209:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891218:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141901.891308:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783141901.891312:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141901.891332:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891375:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380763f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e785 expref: 61 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891393:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e785 expref: 60 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.891401:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141901.891404:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141901.891407:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cdc00, rc 0) 00000100:00100000:3.0:1783141901.891474:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501101056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 383us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.891481:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:2.0:1783141901.899245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.899769:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101184 00000100:00100000:3.0:1783141901.899779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101184 00000100:00100000:3.0:1783141901.899864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1783141901.899874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501101184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141901.899893:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.899912:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380764d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e78c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.899972:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.899986:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.899997:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900034:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900043:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900050:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900111:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900119:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900126:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141901.900164:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783141901.900168:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141901.900185:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900195:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900203:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900210:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900228:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900234:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cde00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.900238:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900244:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900256:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141901.900259:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141901.900264:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807654 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900314:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900320:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900325:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900331:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141901.900334:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900350:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900358:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:3.0:1783141901.900361:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141901.900364:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900381:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380765b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900408:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a380764d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e78c expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900421:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e78c expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.900428:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141901.900430:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141901.900432:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd200, rc 0) 00000100:00100000:3.0:1783141901.900752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11397:x1869759501101184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 878us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.900760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:1.0:1783141901.906199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.906731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.906795:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101568 00000100:00100000:3.0:1783141901.906805:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101568 00000100:00100000:3.0:1783141901.906874:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783141901.906892:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:2401:x1869759501101568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141901.906925:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141901.906951:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e78c expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.906969:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141901.906974:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141901.907039:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:2401:x1869759501101568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 156us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.907046:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:0.0:1783141901.910755:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101440 00000100:00100000:0.0:1783141901.910770:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101440 00000100:00100000:0.0:1783141901.910858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:0.0:1783141901.910868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501101440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141901.910895:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141901.910914:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807669 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e793 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.911011:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.911035:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.911044:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.911088:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141901.911101:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 61 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141901.911114:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092352:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141901.911207:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bd31c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141901.916626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141901.916658:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101696 00000100:00100000:1.0:1783141901.916666:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101696 00010000:00010000:1.0:1783141901.916703:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 62 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141901.916757:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783141901.916766:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:2403:x1869759501101696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141901.916782:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141901.916788:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 62 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.916801:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 62 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.916824:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:1.0:1783141901.916829:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.916839:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.916847:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141901.916866:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141901.916927:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:2403:x1869759501101696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 161us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141901.916936:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00010000:00010000:3.0:1783141901.917121:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ec00/0xb31399d6a3807638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e77e expref: 61 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141901.917138:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521092352:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141901.917159:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.917167:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.917173:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141901.917190:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783141901.917340:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f400/0xb31399d6a3807669 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.917355:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.917373:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141901.917375:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141901.917378:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:3.0:1783141901.917406:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11397:x1869759501101440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6540us (11217us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1783141901.917413:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:1.0:1783141901.921999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141901.922145:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501101952 00000100:00100000:2.0:1783141901.922154:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501101952 00000100:00100000:2.0:1783141901.922219:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783141901.922229:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11397:x1869759501101952:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:2.0:1783141901.922245:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141901.922309:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38075c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e762 expref: 61 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141901.922329:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141901.922334:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141901.922396:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501101952:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 168us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141901.922404:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783141901.925755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.925848:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102080 00000100:00100000:3.0:1783141901.925858:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102080 00000100:00100000:3.0:1783141901.925919:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:3.0:1783141901.925929:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501102080:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:3.0:1783141901.926056:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.926073:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.926084:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141901.926172:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1783141901.926251:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501102080:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 324us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.926260:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1783141901.933992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141901.934070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102208 00000100:00100000:3.0:1783141901.934080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102208 00000100:00100000:3.0:1783141901.934175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783141901.934186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:11397:x1869759501102208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141901.934212:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141901.934232:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e79a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934331:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934342:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934361:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934373:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934386:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141901.934389:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141901.934393:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141901.934400:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc400, rc 0) 00000100:00100000:3.0:1783141901.934454:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11397:x1869759501102208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 270us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141901.934461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:0.0:1783141902.084539:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141902.084602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141902.085636:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521092480 00000100:00100000:1.0:1783141902.085659:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521092480 00000100:00100000:1.0:1783141902.085730:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783141902.085739:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759521092480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141902.085767:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141902.085822:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759521092480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141902.085828:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783141902.085870:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521092480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783141902.088580:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783141902.212490:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141902.340495:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141902.340506:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141902.340554:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1783141902.340563:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141902.340695:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd04700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521092608:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141902.340835:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141902.349782:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd04700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521092608:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141902.350397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.350507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102336 00000100:00100000:3.0:1783141902.350515:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102336 00000100:00100000:3.0:1783141902.350618:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:3.0:1783141902.350644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11398:x1869759501102336:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141902.350678:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141902.350785:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11398:x1869759501102336:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.350793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:1.0:1783141902.361942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.362037:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102464 00000100:00100000:2.0:1783141902.362047:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102464 00000100:00100000:2.0:1783141902.362112:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:2.0:1783141902.362121:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11398:x1869759501102464:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783141902.362202:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362219:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362231:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362245:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362252:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362300:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362324:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362333:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362340:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141902.362399:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783141902.362415:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141902.362430:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362442:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362448:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362455:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362468:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.362473:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362481:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362495:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:2.0:1783141902.362498:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.362503:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362508:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380768c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362520:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362526:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362542:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362547:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.362550:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362555:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362563:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9f9b42686e00) 00010000:00010000:2.0:1783141902.362565:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.362567:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362572:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807693 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362587:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362592:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362597:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362601:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.362603:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362618:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362627:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.362629:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.362632:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.362638:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380769a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.362731:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11398:x1869759501102464:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 609us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.362741:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:1.0:1783141902.373029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.380657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102720 00000100:00100000:3.0:1783141902.380746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102720 00000100:00100000:3.0:1783141902.384322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:3.0:1783141902.384348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:11398:x1869759501102720:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141902.384382:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141902.384402:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7a1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384556:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141902.384568:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783141902.384646:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384654:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384660:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384680:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cde00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141902.384685:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384693:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384709:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141902.384712:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783141902.384716:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384722:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a38076a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384764:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076a1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7a1 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.384773:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:3.0:1783141902.385072:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141902.385078:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7a1 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.385089:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc600, rc 0) 00000100:00100000:3.0:1783141902.385166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501102720:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 830us (12156us total) trans 4294967400 rc 301/301 00000100:00100000:3.0:1783141902.385175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:1.0:1783141902.400977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.401067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501102848 00000100:00100000:3.0:1783141902.401089:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501102848 00000100:00100000:3.0:1783141902.401146:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:3.0:1783141902.401162:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501102848:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141902.401198:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141902.401341:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501102848:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 185us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.401349:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:2.0:1783141902.409341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.409428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501103104 00000100:00100000:0.0:1783141902.409438:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501103104 00000100:00100000:0.0:1783141902.409514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:0.0:1783141902.409524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501103104:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.409543:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141902.409546:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141902.409857:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807646 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e785 expref: 62 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.409877:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:0.0:1783141902.409883:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141902.409897:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141902.410369:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1783141902.410695:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38076bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.410710:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38076bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.410720:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38076bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.410772:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7a8 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.410981:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38076bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7a8 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.410991:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1b00) 00010000:00010000:0.0:1783141902.410994:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141902.410997:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f800, rc 0) 00000100:00100000:0.0:1783141902.411116:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:11398:x1869759501103104:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1593us (1784us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1783141902.411125:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:3.0:1783141902.427430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.427647:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501103360 00000100:00100000:2.0:1783141902.427656:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501103360 00000100:00100000:2.0:1783141902.427716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:2.0:1783141902.427726:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:11398:x1869759501103360:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141902.427793:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141902.427817:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a38076bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7a8 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.427834:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1b00) 00010000:00010000:2.0:1783141902.427843:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141902.427861:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.427890:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.427900:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.427914:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.427921:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428103:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428147:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428154:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428160:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428167:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.428171:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428178:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428188:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:2.0:1783141902.428196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.428200:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428206:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38076cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428218:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428224:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428233:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428237:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.428240:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428245:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428254:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc1441c57 (ffff9f9b42686e00) 00010000:00010000:2.0:1783141902.428257:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.428259:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.428265:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38076d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc1441c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.428397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501103360:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 668us (973us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141902.428544:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:3.0:1783141902.435347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.436582:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501103488 00000100:00100000:0.0:1783141902.436594:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501103488 00000100:00100000:0.0:1783141902.436666:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:0.0:1783141902.436677:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:11398:x1869759501103488:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.436698:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141902.436733:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7af expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436780:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436794:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436805:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436909:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436926:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.436936:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:0.0:1783141902.436939:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141902.436942:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:0.0:1783141902.437009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:11398:x1869759501103488:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 334us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.437026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:1.0:1783141902.443318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.444236:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501103744 00000100:00100000:0.0:1783141902.444248:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501103744 00000100:00100000:0.0:1783141902.444324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:0.0:1783141902.444333:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:11398:x1869759501103744:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.444439:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.444470:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.444483:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141902.444640:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1783141902.444650:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413511377689ns, next at 414511375172ns, rc = 0 00000004:00010000:0.0:1783141902.444695:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac2e050c reply state 00000000544a6b3f transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.444709:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.444715:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:0.0:1783141902.444718:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783141902.444721:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141902.444829:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:11398:x1869759501103744:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 496us (1519us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1783141902.444837:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:3.0:1783141902.455372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.455534:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501103872 00000100:00100000:2.0:1783141902.455544:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501103872 00000100:00100000:3.0:1783141902.455688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:3.0:1783141902.455699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:11398:x1869759501103872:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141902.455725:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141902.455744:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7b6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.455800:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.455814:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.455831:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:3.0:1783141902.455834:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141902.455838:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc600, rc 0) 00000100:00100000:3.0:1783141902.455899:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11398:x1869759501103872:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 201us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.455925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:3.0:1783141902.459959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141902.460071:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501104000 00000100:00100000:1.0:1783141902.460081:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501104000 00000100:00100000:1.0:1783141902.460220:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:1.0:1783141902.460233:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501104000:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783141902.460491:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501104000:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 252us (531us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783141902.460500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00080000:2.0:1783141902.460727:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141902.466600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.466663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501104256 00000100:00100000:0.0:1783141902.466671:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501104256 00000100:00100000:0.0:1783141902.466733:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1783141902.466743:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:11398:x1869759501104256:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783141902.466967:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11398:x1869759501104256:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 224us (375us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1783141902.466975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1783141902.471597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.472880:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501104512 00000100:00100000:3.0:1783141902.472893:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501104512 00000100:00100000:3.0:1783141902.473534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:3.0:1783141902.473548:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11398:x1869759501104512:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783141902.473809:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11398:x1869759501104512:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 265us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.473817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:3.0:1783141902.477967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.478140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501104640 00000100:00100000:0.0:1783141902.478150:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501104640 00000100:00100000:0.0:1783141902.478212:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:0.0:1783141902.478223:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:11398:x1869759501104640:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.478242:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141902.478308:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a38076f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7bd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478375:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478390:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478401:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141902.478444:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141902.478472:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478498:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a38076f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7bd expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478515:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7bd expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.478523:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:0.0:1783141902.478525:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783141902.478528:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fe00, rc 0) 00000100:00100000:0.0:1783141902.478611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:11398:x1869759501104640:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 391us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.478619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:1.0:1783141902.484057:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.484136:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501104768 00000100:00100000:0.0:1783141902.484146:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501104768 00000100:00100000:0.0:1783141902.484204:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783141902.484213:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501104768:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.484231:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141902.484251:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7c4 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141902.484325:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48960e, blocks: 0x0 00010000:00010000:0.0:1783141902.484344:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1783141902.484348:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141902.484356:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.484385:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.484397:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fa00, rc 0) 00000100:00100000:0.0:1783141902.484448:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2403:x1869759501104768:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 235us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.484455:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:1.0:1783141902.488219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.488412:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105024 00000100:00100000:0.0:1783141902.488420:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105024 00000100:00100000:0.0:1783141902.488783:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:0.0:1783141902.488795:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:11398:x1869759501105024:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783141902.488900:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:11398:x1869759501105024:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 108us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.491909:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:1.0:1783141902.492055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.492147:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105152 00000100:00100000:2.0:1783141902.492157:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105152 00000100:00100000:2.0:1783141902.492229:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783141902.492239:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:11398:x1869759501105152:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141902.492267:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141902.492555:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7cb expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.492660:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.492669:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141902.492673:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141902.492679:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.492788:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.492802:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.492835:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521092736:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141902.492932:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c467769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141902.496865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.496985:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521092736:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141902.497025:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.497044:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:2.0:1783141902.497102:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:11398:x1869759501105152:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 4864us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.497111:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783141902.498054:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105280 00000100:00100000:3.0:1783141902.498063:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105280 00010000:00010000:3.0:1783141902.498099:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.498187:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:3.0:1783141902.498197:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2402:x1869759501105280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141902.498211:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141902.498230:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.498244:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.498313:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d043bc0/0xb31399d6a3807703 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7c4 expref: 11 pid: 8438 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.498340:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141902.498344:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141902.498353:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.498521:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.498572:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.498587:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9526:1869759521092864:192.168.203.39@tcp:105: 00000100:00100000:3.0:1783141902.498655:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141902.502883:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9526:1869759521092864:192.168.203.39@tcp:105: 00010000:00010000:3.0:1783141902.502913:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141902.502970:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49a38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2402:x1869759501105280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4772us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.502981:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:1.0:1783141902.507969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.508121:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105408 00000100:00100000:2.0:1783141902.508130:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105408 00002000:00100000:2.0:1783141902.508177:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f9c4bd05880 x1869759501105408/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:278/0 lens 504/0 e 0 to 0 dl 1783141913 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141902.508188:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c4bd05880 with x1869759501105408 ext(0->12) 00002000:00010000:2.0:1783141902.508194:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c4bd05880 00000100:00100000:2.0:1783141902.508226:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1783141902.508236:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2402:x1869759501105408:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783141902.510242:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:2402:x1869759501105408:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 1997us (2272us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783141902.510255:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00002000:00100000:2.0:1783141902.510265:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f9c4bd05880 x1869759501105408/t4294967309(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:278/0 lens 504/448 e 0 to 0 dl 1783141913 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141902.510323:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c4bd05880 with x1869759501105408 ext(0->12) 00002000:00010000:2.0:1783141902.510329:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c4bd05880 00000100:00100000:1.0:1783141902.513729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.513868:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105536 00000100:00100000:2.0:1783141902.513878:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105536 00000100:00100000:2.0:1783141902.513939:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:2.0:1783141902.513949:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:11398:x1869759501105536:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783141902.520199:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:2.0:1783141902.520218:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1783141902.520259:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1783141902.520306:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9c4705e900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1783141902.520311:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c4e79fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c4705e540 00000020:00080000:2.0:1783141902.520314:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c4e79f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b421b6c00 00000004:00080000:2.0:1783141902.520343:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783141902.520366:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9b42467c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1783141902.520380:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440adb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b42467480 00000020:00080000:2.0:1783141902.520383:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440ad200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b4375f600 00000020:00080000:2.0:1783141902.520392:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783141902.520411:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1783141902.520726:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141902.520746:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521092992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783141902.520809:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783141902.520964:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783141902.521086:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11398:x1869759501105536:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 7136us (7362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.521096:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:1.0:1783141902.523636:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521093120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783141902.523703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141902.523746:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141902.523752:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521093248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783141902.523774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141902.524321:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521092992 00000100:00100000:2.0:1783141902.524329:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521092992 00000100:00100000:2.0:1783141902.524410:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521093120 00000100:00100000:2.0:1783141902.524414:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521093120 00000100:00100000:2.0:1783141902.524427:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521093248 00000100:00100000:2.0:1783141902.524430:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521093248 00000100:00100000:2.0:1783141902.524444:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141902.524452:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3654:x1869759521092992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783141902.524488:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1783141902.524517:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a48960d, atime: 0x6a48960e, ctime: 0x6a48960d, blocks: 0x8 00010000:00010000:2.0:1783141902.524525:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524552:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1783141902.524556:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141902.524562:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524580:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524590:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524598:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524616:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141902.524756:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3654:x1869759521092992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 305us (3947us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783141902.524772:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141902.524790:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783141902.524796:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521093120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783141902.524807:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1783141902.524820:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524834:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524842:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783141902.524845:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141902.524849:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524874:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524887:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 11 pid: 8438 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.524900:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521093376:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141902.524958:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c467766c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783141902.524973:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141902.524979:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.524993:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141902.524997:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.525006:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.525030:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.525037:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d804ee3e/0xb31399d6a3807711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.525055:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141902.525056:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141902.525058:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783141902.525089:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9c4bd07800/2, rc 0, transno 4294967305 00000100:00100000:2.0:1783141902.525095:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521092992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783141902.525114:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783141902.525121:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521093248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783141902.525188:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783141902.525191:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783141903 00002000:00010000:2.0:1783141902.525193:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783141902.525195:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783141902 -> 1783141903 00002000:00010000:2.0:1783141902.525198:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783141902.525237:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1869759521093248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1461us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783141902.525244:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1783141902.525307:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9c6f832300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783141902.525312:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521093248:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1783141902.525674:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141902.525900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1783141902.526084:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526096:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526104:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526110:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526115:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526122:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526199:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141902.526203:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141902.526208:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526214:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a380740f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526239:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526259:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.526264:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105664 00010000:00010000:0.0:1783141902.526266:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.526295:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105664 00010000:00010000:0.0:1783141902.526296:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526302:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526308:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526319:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141902.526321:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141902.526324:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526331:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a38074b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.526339:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:2.0:1783141902.526348:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:2401:x1869759501105664:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1783141902.526352:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526360:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526366:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526372:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cce00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526381:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526388:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526397:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:0.0:1783141902.526400:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141902.526403:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526408:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807535 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526421:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526427:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526434:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526439:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526441:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526447:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526455:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9b4246eb00) 00010000:00010000:0.0:1783141902.526457:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141902.526467:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526474:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807558 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526499:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526505:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526511:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526515:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526518:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526524:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526533:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141902.526535:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141902.526538:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526544:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380762a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526555:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526562:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526575:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526580:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.526584:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526590:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526599:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:0.0:1783141902.526602:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141902.526605:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.526611:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a38076e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.530434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.530569:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501105792 00000100:00100000:3.0:1783141902.530579:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501105792 00010000:00010000:3.0:1783141902.530619:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 13 pid: 8438 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.530665:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:3.0:1783141902.530687:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2403:x1869759501105792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141902.530702:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141902.530708:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 13 pid: 8438 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.530721:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 13 pid: 8438 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.530745:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141902.530749:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141902.530754:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.530763:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.530782:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141902.530832:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2403:x1869759501105792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 146us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.530840:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00000001:00080000:2.0:1783141902.532043:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1783141902.532056:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1783141902.532244:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501105664:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 5895us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.532255:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00010000:00010000:0.0:1783141902.532331:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca4182a1/0xb31399d6a38074c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e723 expref: 6 pid: 8438 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.532353:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521093376:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141902.532376:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.532389:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.532414:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.532424:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.532431:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.532458:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141902.532612:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141902.532620:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.532629:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141902.532633:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.532635:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521093120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7837us (8930us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783141902.532652:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1783141902.532653:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.532672:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.532679:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.532687:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783141902.532693:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1783141902.532711:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9c6f832300, transno 4294967310 00010000:00010000:2.0:1783141902.532718:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141902.532720:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141902.532722:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141902.532730:0:3652:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9f9b43577800 x1869759521093120/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783141918 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783141902.532741:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b43577800/2, rc 0, transno 4294967311 00000100:00100000:0.0:1783141902.532745:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521093120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783141902.535843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.535922:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106048 00000100:00100000:3.0:1783141902.535931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106048 00000100:00100000:3.0:1783141902.535984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:3.0:1783141902.535994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11398:x1869759501106048:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783141902.536305:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141902.536362:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38076fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7bd expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.536394:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:3.0:1783141902.536410:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141902.536438:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.536453:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.536472:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141902.536609:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039284af0 reply state 00000000f07d04dc transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.536621:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.536627:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:3.0:1783141902.536630:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141902.536632:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141902.536745:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:11398:x1869759501106048:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 751us (908us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1783141902.536752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:1.0:1783141902.539983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.540154:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106176 00000100:00100000:3.0:1783141902.540163:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106176 00000100:00100000:3.0:1783141902.540220:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:3.0:1783141902.540239:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501106176:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783141902.540428:0:8865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783141902.540432:0:8865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783141903 -> 1783141902 00002000:00010000:3.0:1783141902.540434:0:8865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783141902 00002000:00010000:3.0:1783141902.540436:0:8865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783141903 -> 1783141902 00002000:00010000:3.0:1783141902.540438:0:8865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783141902.540495:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501106176:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 257us (520us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783141902.540502:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783141902.542549:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141902.542657:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106432 00000100:00100000:1.0:1783141902.542666:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106432 00000100:00100000:1.0:1783141902.542720:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:1.0:1783141902.542729:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:11398:x1869759501106432:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783141902.542792:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.542809:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.542836:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.542870:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.542884:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 17 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.542899:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521093504:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141902.542983:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141902.547723:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521093504:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141902.547753:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.548324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.548555:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106560 00000100:00100000:3.0:1783141902.548563:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106560 00010000:00010000:3.0:1783141902.548599:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 18 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.548641:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:3.0:1783141902.548650:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:2403:x1869759501106560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141902.548665:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141902.548672:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 18 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548686:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 18 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548707:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a38076e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7af expref: 18 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548735:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:3.0:1783141902.548740:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548750:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548758:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.548788:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141902.548840:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:2403:x1869759501106560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.548848:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 75 00010000:00010000:0.0:1783141902.548877:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548887:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548925:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548933:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548940:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548946:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141902.548951:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548959:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548971:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:0.0:1783141902.548974:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783141902.548978:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.548983:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807726 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.549051:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11398:x1869759501106432:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 6322us (6508us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783141902.549060:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:0.0:1783141902.555801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.555904:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106688 00000100:00100000:3.0:1783141902.555914:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106688 00000100:00100000:3.0:1783141902.555973:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783141902.555983:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501106688:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783141902.556034:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.556054:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.556063:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141902.556067:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141902.556071:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.556120:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.556134:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 7 pid: 8440 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.556150:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521093632:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141902.556236:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141902.568385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.568499:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521093632:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141902.568524:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.568595:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501106816 00000100:00100000:0.0:1783141902.568602:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501106816 00010000:00010000:0.0:1783141902.568637:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 8 pid: 8440 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.568682:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1783141902.568691:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501106816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141902.568707:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141902.568727:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 8 pid: 8440 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.568739:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 8 pid: 8440 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.568763:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0fa513a/0xb31399d6a380770a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7cb expref: 8 pid: 8440 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.568778:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141902.568782:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141902.568787:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.568815:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.568849:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141902.568904:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501106816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 212us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.568912:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00010000:00010000:2.0:1783141902.568978:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.568987:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569007:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569026:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569033:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569040:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141902.569044:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569052:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569093:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.569102:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061464e23/0xb31399d6a380772d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.569173:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501106688:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 13191us (13382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.569182:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:1.0:1783141902.572440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.572635:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107072 00000100:00100000:2.0:1783141902.572645:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107072 00000100:00100000:2.0:1783141902.572734:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:2.0:1783141902.572743:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:11398:x1869759501107072:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141902.572814:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.572831:0:11334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 16 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.572841:0:11334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.572875:0:11334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 16 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.572889:0:11334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 16 pid: 11334 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.572915:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f857480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521093760:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141902.572996:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c467769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141902.575858:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f857480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521093760:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141902.575885:0:11334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.577666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.577806:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107200 00000100:00100000:2.0:1783141902.577816:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107200 00010000:00010000:2.0:1783141902.577864:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 17 pid: 11334 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.577946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783141902.577957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:2402:x1869759501107200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141902.577974:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141902.577980:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 17 pid: 11334 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.577993:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 17 pid: 11334 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578024:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807623 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e777 expref: 17 pid: 11334 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578041:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.578046:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578067:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578075:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578083:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.578112:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141902.578178:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:2402:x1869759501107200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 223us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.578187:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00010000:00010000:3.0:1783141902.578833:0:11334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.578845:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.579068:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.579082:0:11334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.579089:0:11334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.579134:0:11334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.579147:0:11334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 16 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.579161:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f833480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521093888:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141902.579316:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b42467300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141902.584350:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f833480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521093888:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141902.584379:0:11334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.587231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.592287:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107328 00000100:00100000:3.0:1783141902.592303:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107328 00010000:00010000:3.0:1783141902.592352:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 17 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141902.593083:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783141902.593098:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:2402:x1869759501107328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141902.593116:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141902.593124:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 17 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593149:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 17 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593171:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a38076ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7b6 expref: 17 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593186:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:3.0:1783141902.593312:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593324:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593331:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141902.593384:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141902.593447:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:2402:x1869759501107328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 353us (6223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.593456:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00010000:00010000:1.0:1783141902.594490:0:11334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.594502:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141902.594716:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1783141902.594834:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1783141902.594871:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1783141902.594949:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f876300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11334:1869759521094016:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783141902.595005:0:11334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141902.595049:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141902.595135:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521094016 00000100:00100000:3.0:1783141902.595142:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521094016 00000100:00100000:3.0:1783141902.595188:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783141902.595196:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11334:x1869759521094016:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783141902.595321:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11334:x1869759521094016:12345-0@lo:1000:mdt00_004.0 Request processed in 125us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141902.595329:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783141902.595487:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f876300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11334:1869759521094016:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1783141902.595622:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1783141902.595672:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f857480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11334:1869759521094144:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783141902.595703:0:11334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141902.595725:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141902.595944:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521094144 00000100:00100000:3.0:1783141902.595949:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521094144 00000100:00100000:3.0:1783141902.595985:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783141902.595994:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11334:x1869759521094144:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783141902.596212:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11334:x1869759521094144:12345-0@lo:1000:mdt00_004.0 Request processed in 219us (508us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783141902.596220:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783141902.596700:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f857480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11334:1869759521094144:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1783141902.596742:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596752:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596772:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596778:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cca00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.596782:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596791:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596805:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:2.0:1783141902.596808:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141902.596812:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596819:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a380773b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596841:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596848:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596853:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596858:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cd200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.596862:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596877:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596886:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.596889:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141902.596895:0:11334:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596905:0:11334:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596913:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.596939:0:11334:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.596952:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f854380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521094272:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783141902.597042:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141902.597477:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521094400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141902.597516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141902.599240:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521094400 00000100:00100000:0.0:1783141902.599252:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521094400 00000100:00100000:0.0:1783141902.599338:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783141902.599348:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521094400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141902.599522:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1783141902.599643:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521094400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 297us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.599650:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783141902.599723:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521094400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141902.614867:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f854380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521094272:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783141902.614901:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.614929:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a380767e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.614960:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.614974:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.614985:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.614996:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615001:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615007:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615021:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.615025:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615032:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615042:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.615045:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141902.615048:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.615059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1783141902.615060:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807742 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615087:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615093:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615099:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615104:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141902.615107:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615112:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615121:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.615124:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141902.615356:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.615364:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807734 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141902.615422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107456 00000100:00100000:0.0:1783141902.615430:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107456 00000100:00100000:2.0:1783141902.615529:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:11398:x1869759501107072:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 42786us (43096us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1783141902.615539:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 139 00000020:00080000:2.0:1783141902.615562:0:11334:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783141902.615649:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141902.615654:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141902.616176:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783141902.616185:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141902.616613:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783141902.616627:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:11397:x1869759501107456:12345-192.168.203.39@tcp:49:lfs.0 00000100:00100000:0.0:1783141902.616739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:11397:x1869759501107456:12345-192.168.203.39@tcp:49:lfs.0 Request processed in 116us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141902.616746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:1.0:1783141902.624039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141902.625434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.625571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107968 00000100:00100000:2.0:1783141902.625580:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107968 00000100:00100000:2.0:1783141902.625628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:2.0:1783141902.625637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:11398:x1869759501107968:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783141902.625906:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783141902.625938:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1783141902.625972:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.625988:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.625998:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.626006:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.626023:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.626029:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.626051:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141902.626459:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141902.626466:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.626481:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783141902.626485:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.626493:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.626506:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:1.0:1783141902.626510:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783141902.626514:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.626520:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807749 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.626542:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141902.626544:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141902.626545:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141902.626963:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11398:x1869759501107968:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 1323us (1531us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783141902.626975:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000020:00080000:2.0:1783141902.626980:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783141902.628957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501107712 00000100:00100000:3.0:1783141902.628971:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501107712 00000100:00100000:2.0:1783141902.629134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:2.0:1783141902.629152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11397:x1869759501107712:12345-192.168.203.39@tcp:58:lfs.0 00000040:00080000:2.0:1783141902.629354:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783141902.629432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11397:x1869759501107712:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 281us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.629439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:1.0:1783141902.663377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141902.663464:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501108096 00000100:00100000:0.0:1783141902.664105:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501108096 00000100:00100000:0.0:1783141902.664198:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1783141902.664229:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:11400:x1869759501108096:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141902.664253:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141902.664331:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807750 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7d2 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.664462:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.666006:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141902.666029:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666597:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666620:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666629:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666707:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666721:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666728:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.666766:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.670596:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 22 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.670621:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f876680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521094528:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141902.670753:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141902.675028:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f876680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521094528:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141902.675056:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141902.675700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141902.675913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501108352 00000100:00100000:2.0:1783141902.675920:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501108352 00000100:00100000:2.0:1783141902.675981:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:2.0:1783141902.675990:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:6168:x1869759501108352:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783141902.676189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:6168:x1869759501108352:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 200us (490us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1783141902.676196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:1.0:1783141902.678892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141902.681443:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501108480 00000100:00100000:3.0:1783141902.681512:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501108480 00010000:00010000:2.0:1783141902.681781:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 24 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141902.681877:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:2.0:1783141902.681888:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:2403:x1869759501108480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141902.681905:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141902.681912:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 24 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.681924:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 24 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.682391:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e793 expref: 24 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.682409:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:2.0:1783141902.682414:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.682424:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.682432:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141902.682473:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141902.682540:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:2403:x1869759501108480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 654us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141902.682548:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00010000:00010000:1.0:1783141902.682818:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682827:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141902.682887:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783141902.682891:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141902.682910:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682922:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682931:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682937:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682943:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682949:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141902.682953:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682960:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682969:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:1.0:1783141902.682972:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141902.682975:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.682980:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807757 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683001:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683006:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683022:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683027:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141902.683030:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683036:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683044:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f9c7b5c6900) 00010000:00010000:1.0:1783141902.683047:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141902.683049:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683055:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a380775e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683093:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d2 expref: 23 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683106:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d2 expref: 22 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141902.683124:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:1.0:1783141902.683127:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141902.683129:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2000, rc 0) 00000100:00100000:1.0:1783141902.683175:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11400:x1869759501108096:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 18948us (19806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141902.683183:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00010000:00010000:2.0:1783141903.237777:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783141903.432354:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1783141903.432373:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:3.0:1783141903.523477:0:14261:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141903.523487:0:14261:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141903.523517:0:14261:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783141903.523525:0:14261:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1783141903.621416:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141903.621425:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141903.621451:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783141903.621582:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141903.621708:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f877100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521094656:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141903.621802:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141903.627860:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f877100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521094656:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141903.629695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141903.629951:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501108608 00000100:00100000:2.0:1783141903.629960:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501108608 00000100:00100000:2.0:1783141903.630033:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:2.0:1783141903.630043:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11413:x1869759501108608:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141903.630078:0:11334:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141903.630186:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11413:x1869759501108608:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 145us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141903.630195:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00080000:1.0:1783141903.630590:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141903.635367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141903.635649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501108864 00000100:00100000:0.0:1783141903.635659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501108864 00000100:00100000:0.0:1783141903.635722:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:0.0:1783141903.635732:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:11413:x1869759501108864:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141903.635751:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141903.635769:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380776c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7d9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141903.635870:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807773 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141903.635885:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141903.635897:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807773 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141903.635924:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783141903.636039:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a380776c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d9 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141903.636057:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807773 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141903.636065:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141903.636068:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141903.636072:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f800, rc 0) 00000100:00100000:0.0:1783141903.636124:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:11413:x1869759501108864:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 393us (775us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1783141903.636132:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:3.0:1783141903.644141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141903.644191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141903.644227:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501109248 00000100:00100000:3.0:1783141903.644236:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501109248 00000100:00100000:3.0:1783141903.644322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783141903.644332:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c49a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:2400:x1869759501109248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141903.644347:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141903.644386:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807773 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141903.644403:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141903.644408:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141903.644461:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c49a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:2400:x1869759501109248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 130us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141903.644629:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501109120 00000100:00100000:1.0:1783141903.644634:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501109120 00000100:00100000:1.0:1783141903.644671:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:1.0:1783141903.644679:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:11413:x1869759501109120:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783141903.644743:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644757:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644768:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644924:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644932:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644938:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644943:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141903.644948:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644955:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644965:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:1.0:1783141903.644967:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141903.644971:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141903.644976:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807781 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141903.645063:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:11413:x1869759501109120:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 385us (930us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1783141903.645071:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:3.0:1783141903.645143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000040:00080000:3.0:1783141903.645646:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141903.645651:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141903.646220:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783141903.646239:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141903.650157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141903.650223:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501109504 00000100:00100000:2.0:1783141903.650245:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501109504 00000100:00100000:2.0:1783141903.650321:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783141903.650331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:11413:x1869759501109504:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783141903.651066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:11413:x1869759501109504:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 734us (915us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783141903.651075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00010000:00010000:1.0:1783141904.261735:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141905.291723:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141905.354944:0:14313:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141905.354953:0:14313:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141905.354990:0:14313:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783141905.361390:0:14313:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141905.545621:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141905.548234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501109760 00000100:00100000:3.0:1783141905.548248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501109760 00000100:00100000:0.0:1783141905.548473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00100000:0.0:1783141905.548487:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:11433:x1869759501109760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141905.548510:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141905.548530:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807788 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141905.548630:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380778f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141905.548645:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380778f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141905.548657:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380778f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141905.548681:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783141905.548782:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807788 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e0 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141905.548803:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380778f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e0 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141905.548810:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:0.0:1783141905.548813:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783141905.548816:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fa00, rc 0) 00000100:00100000:0.0:1783141905.548878:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:11433:x1869759501109760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 394us (3266us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783141905.548885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00080000:1.0:1783141905.549139:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141905.566172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141905.572635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501109888 00000100:00100000:3.0:1783141905.572648:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501109888 00000100:00100000:3.0:1783141905.572759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:3.0:1783141905.572770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:11433:x1869759501109888:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783141905.572840:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572856:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572869:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572906:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572914:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572921:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572926:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cc600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141905.572931:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572937:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572962:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141905.572965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141905.572969:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.572975:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc600/0xb31399d6a380779d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141905.573078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:11433:x1869759501109888:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 310us (6913us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141905.573085:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:0.0:1783141905.666677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.666714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.667119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.667144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.667162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.667187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141905.667215:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110528 00000100:00100000:0.0:1783141905.667224:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110528 00000100:00100000:0.0:1783141905.667361:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110144 00000100:00100000:0.0:1783141905.667365:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110144 00000100:00100000:0.0:1783141905.667384:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110656 00000100:00100000:0.0:1783141905.667387:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110656 00000100:00100000:0.0:1783141905.667408:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:0.0:1783141905.667483:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501110528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141905.667634:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501110528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 216us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141905.667642:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:0.0:1783141905.667660:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:0.0:1783141905.667666:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501110144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141905.667690:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501110144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141905.667696:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:0.0:1783141905.667707:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:0.0:1783141905.667714:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501110656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141905.668118:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501110656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 402us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141905.668125:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:0.0:1783141905.668154:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110272 00000100:00100000:0.0:1783141905.668159:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110272 00000100:00100000:0.0:1783141905.668187:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110400 00000100:00100000:0.0:1783141905.668190:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110400 00000100:00100000:0.0:1783141905.668215:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:0.0:1783141905.668222:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501110272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141905.668360:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501110272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 137us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141905.668367:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:0.0:1783141905.668381:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:0.0:1783141905.668388:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501110400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141905.668571:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501110400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 122us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141905.668579:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00080000:0.0:1783141905.668602:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141905.668605:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141905.668608:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141905.668610:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141905.669076:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110016 00000100:00100000:2.0:1783141905.669082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110016 00000100:00100000:1.0:1783141905.669113:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141905.669114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 376 00000100:00100000:2.0:1783141905.669121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501110016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141905.669163:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521094784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141905.669205:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501110016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141905.669209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141905.669212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 376 00000100:00100000:3.0:1783141905.669680:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521094784 00000100:00100000:3.0:1783141905.669685:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521094784 00000100:00100000:3.0:1783141905.669776:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783141905.669784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521094784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141905.669810:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141905.669855:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521094784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141905.669861:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141905.670144:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521094784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141905.698575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141905.698728:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110784 00000100:00100000:3.0:1783141905.698739:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110784 00000100:00100000:3.0:1783141905.698798:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783141905.698808:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501110784:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783141905.698826:0:8865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141905.698845:0:8865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050d8473e/0xb31399d6a38077a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7e7 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141905.698887:0:8865:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a48960e, atime: 0x6a48960e, ctime: 0x6a48960e, blocks: 0x8 00010000:00010000:3.0:1783141905.698909:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1783141905.698913:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141905.698923:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050d8473e/0xb31399d6a38077a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e7 expref: 7 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.698941:0:8865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050d8473e/0xb31399d6a38077a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e7 expref: 7 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141905.698952:0:8865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cc600, rc 0) 00000100:00100000:3.0:1783141905.699018:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cb08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2401:x1869759501110784:12345-192.168.203.39@tcp:101:cat.0 Request processed in 211us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141905.699024:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:0.0:1783141905.704637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141905.705125:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501110912 00000100:00100000:1.0:1783141905.705135:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501110912 00002000:00100000:1.0:1783141905.705190:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f9c6f7f9f80 x1869759501110912/t0(0) o3->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:281/0 lens 488/0 e 0 to 0 dl 1783141916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141905.705202:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f7f9f80 with x1869759501110912 ext(0->4095) 00002000:00010000:1.0:1783141905.705208:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c6f7f9f80 00000100:00100000:1.0:1783141905.705244:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:1.0:1783141905.705253:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2400:x1869759501110912:12345-192.168.203.39@tcp:3:cat.0 00000100:00100000:1.0:1783141905.705477:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2400:x1869759501110912:12345-192.168.203.39@tcp:3:cat.0 Request processed in 222us (847us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783141905.705484:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00002000:00100000:1.0:1783141905.705491:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f9c6f7f9f80 x1869759501110912/t0(0) o3->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:281/0 lens 488/4536 e 0 to 0 dl 1783141916 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141905.705498:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f7f9f80 with x1869759501110912 ext(0->4095) 00002000:00010000:1.0:1783141905.705501:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c6f7f9f80 00000100:00100000:2.0:1783141906.180510:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4427aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521094912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141906.180584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141906.180823:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141906.180876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141906.180915:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521094912 00000100:00100000:0.0:1783141906.180922:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521094912 00000100:00100000:0.0:1783141906.180970:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095040 00000100:00100000:0.0:1783141906.180973:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095040 00000100:00100000:0.0:1783141906.181000:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783141906.181009:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521094912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783141906.181049:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141906.181148:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783141906.181157:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521095040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141906.181169:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783141906.181218:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521095040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141906.181226:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1783141906.181257:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141906.185013:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521095424:0@lo:400:kworker.0 00000100:00100000:2.0:1783141906.185096:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.185263:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521095296:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.185335:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141906.185343:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521095168:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.185412:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095296 00000100:00100000:3.0:1783141906.185419:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095296 00000100:00100000:3.0:1783141906.185461:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783141906.185469:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521095296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185519:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521095296:12345-0@lo:400:kworker.0 Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.185542:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783141906.185565:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095168 00000100:00100000:3.0:1783141906.185568:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095168 00000100:00100000:3.0:1783141906.185591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783141906.185597:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521095168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521095168:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.185632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783141906.185674:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521095168:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185700:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521095296:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185748:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095424 00000100:00100000:3.0:1783141906.185752:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095424 00000100:00100000:3.0:1783141906.185775:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783141906.185781:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521095424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.185810:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521095424:12345-0@lo:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.185816:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783141906.185870:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1783141906.185876:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1783141906.185889:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9c6f7f9880, transno 4294967302 00000004:00080000:3.0:1783141906.185899:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1783141906.185907:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9c4bd07800, transno 4294967305 00000100:00100000:3.0:1783141906.185917:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141906.197216:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521094912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16198us (16623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141906.197232:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783141906.198810:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521095808:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199162:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521095552:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199242:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.199296:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521096064:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.199345:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783141906.199350:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521095936:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.199385:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521096448:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.199433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095552 00000100:00100000:3.0:1783141906.199439:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095552 00000100:00100000:3.0:1783141906.199479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095936 00000100:00100000:3.0:1783141906.199482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095936 00000100:00100000:3.0:1783141906.199508:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096448 00000100:00100000:3.0:1783141906.199510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096448 00000100:00100000:3.0:1783141906.199528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783141906.199535:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521095552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199585:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521095552:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.199591:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783141906.199607:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783141906.199612:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521095936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199636:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521095936:12345-0@lo:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.199641:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783141906.199650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783141906.199655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521096448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199701:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4367b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521096448:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.199707:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783141906.199723:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096064 00000100:00100000:3.0:1783141906.199726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096064 00000100:00100000:3.0:1783141906.199748:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783141906.199753:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521096064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.199778:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521096064:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.199783:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1783141906.199822:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f876680 x1869759521095936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141906.199961:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521095936:0@lo:400:kworker.0 00010000:00080000:3.0:1783141906.199976:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f875f80 x1869759521096448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141906.199984:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521096448:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200003:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521095552:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200011:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521096064:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200124:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521095680:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200154:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.200172:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521096192:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141906.200218:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096192 00000100:00100000:3.0:1783141906.200229:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096192 00000100:00100000:3.0:1783141906.200255:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783141906.200261:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3654:x1869759521096192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200313:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3654:x1869759521096192:12345-0@lo:400:kworker.0 Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.200319:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783141906.200336:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095680 00000100:00100000:3.0:1783141906.200338:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095680 00000100:00100000:3.0:1783141906.200357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783141906.200363:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521095680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200390:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521095680:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141906.200395:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783141906.200419:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521095680:0@lo:400:kworker.0 00000100:00100000:3.0:1783141906.200427:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521096192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141906.200532:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141906.200549:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521096320:0@lo:400:kworker.0 00000100:00100000:1.0:1783141906.200567:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141906.200600:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521095808 00000100:00100000:1.0:1783141906.200604:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521095808 00000100:00100000:1.0:1783141906.200628:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096320 00000100:00100000:1.0:1783141906.200630:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096320 00000100:00100000:1.0:1783141906.200649:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783141906.200655:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141906.200699:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521095808:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141906.200706:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783141906.200720:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1783141906.200725:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521096320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141906.200750:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1869759521096320:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141906.200755:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1783141906.200775:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141906.200778:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141906.200780:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141906.200795:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521095808:0@lo:400:kworker.0 00000100:00100000:1.0:1783141906.200803:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521096320:0@lo:400:kworker.0 00000100:00100000:2.0:1783141906.203236:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4427aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521094912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141906.203290:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521095424:0@lo:400:kworker.0 00010000:00010000:1.0:1783141906.308526:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141906.697222:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521096576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141906.697355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141906.698705:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096576 00000100:00100000:0.0:1783141906.698717:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096576 00000100:00100000:0.0:1783141906.698832:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783141906.698843:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521096576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141906.698892:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783141906.698976:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521096576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141906.699004:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783141906.699085:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521096576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141907.206472:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141907.206495:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521096704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141907.206564:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141907.206644:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096704 00000100:00100000:1.0:1783141907.206650:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096704 00000100:00100000:1.0:1783141907.206697:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783141907.206707:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521096704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141907.206738:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783141907.206788:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521096704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141907.206796:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783141907.206852:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521096704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141907.332607:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141907.716506:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141907.716531:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521096832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141907.716606:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141907.716672:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096832 00000100:00100000:2.0:1783141907.716681:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096832 00000100:00100000:2.0:1783141907.716738:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783141907.716748:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521096832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783141907.716772:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783141907.716826:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521096832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141907.716834:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783141907.716940:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521096832:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1783141907.718795:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1783141907.718810:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1783141907.724945:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1783141907.724985:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9c46776c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783141907.724990:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440ad600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c467769c0 00000020:00080000:2.0:1783141907.724995:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440ad900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c59d91200 00000020:00080000:2.0:1783141907.725022:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1783141907.725105:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1783141907.725173:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1783141907.725230:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725242:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725249:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725256:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cde00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141907.725260:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725268:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725616:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f9c7b5c1200) 00010000:00010000:1.0:1783141907.725621:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141907.725625:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141907.725633:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a380771f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141908.358020:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141909.383653:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141910.217707:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783141910.405053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141910.405146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111040 00000100:00100000:3.0:1783141910.405156:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111040 00000100:00100000:3.0:1783141910.405232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:3.0:1783141910.405242:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:11085:x1869759501111040:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783141910.405388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:11085:x1869759501111040:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141910.405414:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00080000:1.0:1783141910.406175:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141910.406305:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141910.416120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141910.416213:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111168 00000100:00100000:1.0:1783141910.416223:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111168 00000100:00100000:1.0:1783141910.416324:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:1.0:1783141910.416334:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:11085:x1869759501111168:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783141910.416418:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:11085:x1869759501111168:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141910.416426:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00080000:2.0:1783141910.416853:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141910.420050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141910.422748:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111424 00000100:00100000:2.0:1783141910.422762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111424 00000100:00100000:2.0:1783141910.422848:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:2.0:1783141910.422859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:11085:x1869759501111424:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783141910.423109:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:11085:x1869759501111424:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 250us (3068us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783141910.423117:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:1.0:1783141910.789066:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141910.789088:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521096960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141910.789209:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141910.789589:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521096960 00000100:00100000:3.0:1783141910.789597:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521096960 00000100:00100000:3.0:1783141910.789653:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783141910.789665:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521096960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141910.789700:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141910.789761:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521096960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141910.789767:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783141910.789869:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521096960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141910.792677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141910.792719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141910.792749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141910.792787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141910.792831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141910.793049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111552 00000100:00100000:2.0:1783141910.793068:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111552 00000100:00100000:2.0:1783141910.793117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 378 00000100:00100000:2.0:1783141910.793126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501111552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141910.793190:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2401:x1869759501111552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141910.793198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 378 00000100:00100000:1.0:1783141910.793303:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112064 00000100:00100000:1.0:1783141910.793308:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112064 00000100:00100000:1.0:1783141910.793349:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111936 00000100:00100000:1.0:1783141910.793352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111936 00000100:00100000:1.0:1783141910.793377:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:1.0:1783141910.793383:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501112064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141910.793416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501112064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141910.793429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:1.0:1783141910.793444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 279 00000100:00100000:1.0:1783141910.793450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501111936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141910.793477:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501111936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141910.793483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 279 00000100:00080000:2.0:1783141910.793814:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141910.793818:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141910.794106:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111808 00000100:00100000:3.0:1783141910.794111:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111808 00000100:00100000:3.0:1783141910.794157:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501111680 00000100:00100000:3.0:1783141910.794160:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501111680 00000100:00100000:3.0:1783141910.794188:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:3.0:1783141910.794195:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501111808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141910.794232:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2401:x1869759501111808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141910.794238:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:3.0:1783141910.794250:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00100000:3.0:1783141910.794256:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501111680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141910.794329:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2401:x1869759501111680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141910.794335:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00080000:2.0:1783141910.794627:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141910.794630:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141910.813823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141910.816524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112192 00000100:00100000:3.0:1783141910.816539:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112192 00000100:00100000:3.0:1783141910.816687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:3.0:1783141910.816697:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:11893:x1869759501112192:12345-192.168.203.39@tcp:101:lsof.0 00010000:00010000:3.0:1783141910.816718:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141910.816737:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38077ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816795:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816809:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816820:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141910.816876:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141910.816880:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141910.816917:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816942:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a38077ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816972:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141910.816980:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:3.0:1783141910.816982:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141910.816986:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cce00, rc 0) 00000100:00100000:3.0:1783141910.817055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+6:11893:x1869759501112192:12345-192.168.203.39@tcp:101:lsof.0 Request processed in 359us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141910.817071:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 149 00000040:00080000:2.0:1783141910.852977:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141910.852986:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141910.853008:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783141910.853018:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783141911.300603:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141911.300740:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521097344:0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.300820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141911.300920:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141911.300928:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521097216:0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.300967:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141911.301006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097216 00000100:00100000:3.0:1783141911.301012:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097216 00000100:00100000:3.0:1783141911.301058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1783141911.301067:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521097216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.301130:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521097216:12345-0@lo:400:kworker.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141911.301138:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1783141911.301247:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521097216:0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.301268:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097344 00000100:00100000:3.0:1783141911.301292:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097344 00000100:00100000:3.0:1783141911.301322:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1783141911.301328:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521097344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.301364:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521097344:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141911.301371:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1783141911.301396:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521097344:0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.301438:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141911.301446:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521097472:0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.301488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141911.305582:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521097088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141911.305650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141911.305683:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141911.305690:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521097600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141911.305711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141911.305744:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097088 00000100:00100000:2.0:1783141911.305751:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097088 00000100:00100000:2.0:1783141911.305796:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097600 00000100:00080000:3.0:1783141911.305921:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141911.305942:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783141911.305963:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521097088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141911.305993:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141911.306038:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521097088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141911.306046:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783141911.306097:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521097088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141911.306148:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097472 00000100:00100000:3.0:1783141911.306152:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097472 00000100:00100000:3.0:1783141911.306182:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783141911.306189:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521097472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141911.306232:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7b6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521097472:12345-0@lo:400:kworker.0 Request processed in 43us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141911.306238:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783141911.306267:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521097472:0@lo:400:kworker.0 00000100:00100000:2.0:1783141911.308628:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097600 00000100:00100000:2.0:1783141911.308714:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783141911.308723:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521097600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141911.308746:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783141911.308968:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141911.309012:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521097600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 289us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141911.309032:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783141911.309147:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141911.309160:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521097728:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.309231:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097728 00000100:00100000:1.0:1783141911.309235:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097728 00000100:00100000:1.0:1783141911.309263:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1783141911.309283:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521097728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309319:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521097728:12345-0@lo:400:kworker.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141911.309325:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1783141911.309358:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521097728:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309394:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521097856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309431:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.309476:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141911.309483:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521097984:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.309528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097984 00000100:00100000:1.0:1783141911.309532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097984 00000100:00100000:1.0:1783141911.309567:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783141911.309573:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521097984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521097984:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141911.309613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783141911.309639:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521097984:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309667:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521098112:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.309724:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098112 00000100:00100000:1.0:1783141911.309728:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098112 00000100:00100000:1.0:1783141911.309753:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1783141911.309761:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521098112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.309793:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521098112:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141911.309809:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00080000:1.0:1783141911.309838:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f875500 x1869759521098112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141911.309849:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521098112:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310229:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141911.310237:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521098240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.310314:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098240 00000100:00100000:1.0:1783141911.310318:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098240 00000100:00100000:1.0:1783141911.310347:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141911.310354:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521098240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310399:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521098240:12345-0@lo:400:kworker.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141911.310405:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141911.310433:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521098240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310464:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521098368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310484:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141911.310507:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098368 00000100:00100000:1.0:1783141911.310511:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098368 00000100:00100000:1.0:1783141911.310534:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783141911.310540:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.310570:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521098368:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141911.310577:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783141911.310595:0:3655:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1783141911.310600:0:3655:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b43577800, transno 4294967311 00000100:00100000:0.0:1783141911.310673:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521097856 00000100:00100000:0.0:1783141911.310678:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521097856 00000100:00100000:0.0:1783141911.310703:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783141911.310709:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521097856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141911.310744:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521097856:12345-0@lo:400:kworker.0 Request processed in 34us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141911.310750:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783141911.310833:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521098624:0@lo:400:kworker.0 00000100:00100000:0.0:1783141911.310857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141911.310885:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141911.310890:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521098496:0@lo:400:kworker.0 00000100:00100000:0.0:1783141911.310911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141911.310960:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098624 00000100:00100000:0.0:1783141911.310965:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098624 00000100:00100000:0.0:1783141911.310988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098496 00000100:00100000:0.0:1783141911.310990:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098496 00000100:00100000:0.0:1783141911.311007:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783141911.311013:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141911.311046:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1869759521098624:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141911.311052:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783141911.311063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1783141911.311069:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141911.311095:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521098496:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141911.311100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1783141911.311135:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521098496:0@lo:400:kworker.0 00010000:00080000:0.0:1783141911.311145:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f908380 x1869759521098624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141911.311154:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1869759521098624:0@lo:400:kworker.0 00000100:00080000:3.0:1783141911.314159:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141911.314170:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141911.314174:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141911.314238:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521097600:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1783141911.314609:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1783141911.314631:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521098368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141911.314650:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521097856:0@lo:400:kworker.0 00010000:00010000:2.0:1783141911.430887:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141911.812605:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521098752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141911.812690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141911.812815:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098752 00000100:00100000:0.0:1783141911.812823:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098752 00000100:00100000:0.0:1783141911.812874:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783141911.812883:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521098752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141911.812915:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783141911.813529:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521098752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 646us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141911.813537:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783141911.813800:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521098752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141912.324484:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521098880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141912.324554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141912.324870:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521098880 00000100:00100000:2.0:1783141912.324878:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521098880 00000100:00100000:2.0:1783141912.324941:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783141912.324959:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521098880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141912.324990:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783141912.327089:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521098880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2123us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141912.327101:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783141912.329816:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521098880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141912.453407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141912.836671:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141912.836695:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521099008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141912.836768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141912.836905:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099008 00000100:00100000:0.0:1783141912.836914:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099008 00000100:00100000:0.0:1783141912.836987:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783141912.836997:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521099008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141912.837022:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783141912.837077:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521099008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141912.837085:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783141912.837202:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521099008:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141913.478358:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783141913.863738:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1783141913.863752:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1783141913.863979:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1783141913.863992:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1783141914.016521:0:14510:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:11:53 (1783141913) 00010000:00010000:2.0:1783141914.500856:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141915.334267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141915.336005:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112448 00000100:00100000:1.0:1783141915.336027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112448 00000100:00100000:1.0:1783141915.336117:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:1.0:1783141915.336131:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:12159:x1869759501112448:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141915.336155:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141915.336235:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38077b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7f5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336367:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336381:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336395:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336430:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336438:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336444:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336547:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38077ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336556:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38077ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.336563:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38077ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141915.336573:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000100:00080000:3.0:1783141915.337750:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783141915.337787:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337817:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337824:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337830:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141915.337834:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337842:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337856:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c4d337300) 00010000:00010000:1.0:1783141915.337859:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141915.337864:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.337871:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38077c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338175:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338182:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338187:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338193:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141915.338203:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338209:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338217:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f9c7b5c4200) 00010000:00010000:1.0:1783141915.338219:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141915.338222:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.338227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38077c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.339193:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38077b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7f5 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.339212:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38077ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7f5 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.339219:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:1.0:1783141915.339221:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141915.339224:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:1.0:1783141915.339327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:12159:x1869759501112448:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 3200us (5067us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1783141915.339336:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:3.0:1783141915.344662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141915.344703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141915.344714:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112576 00000100:00100000:0.0:1783141915.344724:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112576 00000100:00100000:0.0:1783141915.344839:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:0.0:1783141915.344849:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:12159:x1869759501112576:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783141915.344919:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112704 00000100:00100000:1.0:1783141915.344934:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112704 00000100:00100000:0.0:1783141915.344986:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:12159:x1869759501112576:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141915.344995:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:1.0:1783141915.345161:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783141915.345172:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:2402:x1869759501112704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141915.345197:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141915.345220:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a38077ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7f5 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141915.345240:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:1.0:1783141915.345245:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141915.345293:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:2402:x1869759501112704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 104us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141915.345300:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783141915.353488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141915.353684:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112832 00000100:00100000:1.0:1783141915.353695:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112832 00000100:00100000:1.0:1783141915.353773:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00100000:1.0:1783141915.353784:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:12159:x1869759501112832:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1783141915.353862:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141915.353896:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:12159:x1869759501112832:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 113us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141915.353904:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 152 00010000:00010000:2.0:1783141915.526407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141915.907094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141915.907144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141915.907176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141915.907270:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113216 00000100:00100000:1.0:1783141915.907303:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113216 00000100:00100000:1.0:1783141915.907363:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:1.0:1783141915.907373:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501113216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141915.907466:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2400:x1869759501113216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141915.907474:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00080000:1.0:1783141915.907499:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141915.907990:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501112960 00000100:00100000:0.0:1783141915.907995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501112960 00000100:00100000:0.0:1783141915.908035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 380 00000100:00100000:0.0:1783141915.908043:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501112960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141915.908082:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501112960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141915.908089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 380 00000100:00100000:3.0:1783141915.908768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141915.908794:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141915.908862:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113088 00000100:00100000:1.0:1783141915.908868:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113088 00000100:00100000:1.0:1783141915.908928:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:1.0:1783141915.908936:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501113088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141915.908970:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2400:x1869759501113088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141915.908976:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:1.0:1783141915.909045:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521099136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783141915.909094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141915.909170:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099136 00000100:00100000:1.0:1783141915.909174:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099136 00000100:00100000:1.0:1783141915.909199:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783141915.909205:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521099136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141915.909230:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141915.909265:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521099136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141915.909297:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1783141915.909318:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141915.909347:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521099136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141915.914727:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113472 00000100:00100000:2.0:1783141915.914741:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113472 00000100:00080000:1.0:1783141915.914901:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141915.914939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113344 00000100:00100000:2.0:1783141915.914944:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113344 00000100:00100000:2.0:1783141915.914995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 286 00000100:00100000:2.0:1783141915.915004:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501113472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141915.915041:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:3.0:1783141915.915053:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2400:x1869759501113344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141915.915108:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2400:x1869759501113344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 59us (6314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141915.915116:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:2.0:1783141915.915163:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501113472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 158us (7985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141915.915307:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 286 00000100:00080000:1.0:1783141915.915310:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783141915.974661:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141915.974670:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141915.974693:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783141915.974703:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783141916.357707:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783141916.420959:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141916.421097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.421182:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099264 00000100:00100000:3.0:1783141916.421189:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099264 00000100:00100000:3.0:1783141916.421255:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783141916.421291:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521099264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141916.421320:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141916.421451:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521099264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141916.421459:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1783141916.421491:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141916.421530:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141916.423601:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521099392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141916.423661:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.423843:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099392 00000100:00100000:2.0:1783141916.423850:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099392 00000100:00100000:2.0:1783141916.423906:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783141916.423924:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521099392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141916.423945:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141916.423986:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521099392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.423993:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1783141916.424450:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141916.424486:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521099392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141916.425676:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521099648:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.425741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.425785:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521100160:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.425808:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.425830:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521100672:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.425851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.425871:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783141916.425877:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521099520:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.425904:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.425935:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521100032:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.425959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.425978:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521100544:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.426040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.426072:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099648 00000100:00100000:2.0:1783141916.426084:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099648 00000100:00100000:2.0:1783141916.426119:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100160 00000100:00100000:2.0:1783141916.426122:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100160 00000100:00100000:2.0:1783141916.426141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100672 00000100:00100000:2.0:1783141916.426143:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100672 00000100:00100000:2.0:1783141916.426158:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783141916.426164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521099648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.426212:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521099648:12345-0@lo:400:kworker.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.426219:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783141916.426235:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783141916.426241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521100160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.426298:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521100160:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.426304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783141916.426315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783141916.426321:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521100672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.426348:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521100672:12345-0@lo:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.426353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783141916.426626:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099520 00000100:00100000:3.0:1783141916.426630:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099520 00000100:00100000:3.0:1783141916.426670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1783141916.426734:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521099520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.426771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521099520:12345-0@lo:400:kworker.0 Request processed in 95us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141916.426776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:3.0:1783141916.426803:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141916.426815:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521099776:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.426839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.426866:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521100288:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.426887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.426902:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521100800:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.426954:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.426971:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783141916.426978:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4bd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521099904:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.426998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.427008:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521100416:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.427041:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141916.427072:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100032 00000100:00100000:3.0:1783141916.427076:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100032 00000100:00100000:3.0:1783141916.427101:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099776 00000100:00100000:3.0:1783141916.427104:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099776 00000100:00100000:3.0:1783141916.427118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141916.427124:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521100032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.427157:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521100032:12345-0@lo:400:kworker.0 Request processed in 33us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141916.427163:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141916.427175:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783141916.427180:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521099776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.427210:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521099776:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141916.427216:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783141916.427234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100544 00000100:00100000:3.0:1783141916.427236:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100544 00000100:00100000:3.0:1783141916.427261:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100416 00000100:00100000:2.0:1783141916.427449:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100288 00000100:00100000:2.0:1783141916.427453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100288 00000100:00100000:2.0:1783141916.427470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100800 00000100:00100000:2.0:1783141916.427472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100800 00000100:00100000:2.0:1783141916.427483:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521099904 00000100:00100000:2.0:1783141916.427485:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521099904 00000100:00100000:2.0:1783141916.427495:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1783141916.427500:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521100288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.427542:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521100288:12345-0@lo:400:kworker.0 Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.427549:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1783141916.427562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783141916.427568:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b437c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521100800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.427594:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b437c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521100800:12345-0@lo:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.427599:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783141916.427610:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1783141916.427615:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521099904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.427638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521099904:12345-0@lo:400:kworker.0 Request processed in 23us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.427643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1783141916.427668:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783141916.427675:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521100544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141916.428434:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521099904:0@lo:400:kworker.0 00000100:00100000:1.0:1783141916.428447:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521099776:0@lo:400:kworker.0 00010000:00080000:1.0:1783141916.428458:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f875500 x1869759521100288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141916.428468:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521100288:0@lo:400:kworker.0 00010000:00080000:1.0:1783141916.428490:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44236a00 x1869759521100800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141916.428498:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521100800:0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.428779:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100416 00000100:00100000:3.0:1783141916.428823:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783141916.428829:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521100416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141916.428869:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521100416:12345-0@lo:400:kworker.0 Request processed in 40us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141916.428875:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1783141916.428899:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141916.428903:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141916.428929:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521100416:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.428973:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521100544:12345-0@lo:400:kworker.0 Request processed in 1298us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.428980:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783141916.429018:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521099520:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.429030:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521100032:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.429040:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521100544:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.429050:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4bd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521099648:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.429060:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521100160:0@lo:400:kworker.0 00000100:00100000:2.0:1783141916.429080:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521100672:0@lo:400:kworker.0 00010000:00010000:3.0:1783141916.549018:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141916.933291:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521100928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141916.933364:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141916.933452:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521100928 00000100:00100000:2.0:1783141916.933461:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521100928 00000100:00100000:2.0:1783141916.933505:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783141916.933513:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521100928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783141916.933753:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1783141916.933826:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521100928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 313us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141916.933834:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783141916.933895:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521100928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783141917.058789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.058906:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113600 00000100:00100000:2.0:1783141917.058924:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113600 00000100:00100000:2.0:1783141917.058989:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 153 00000100:00100000:2.0:1783141917.058998:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:12202:x1869759501113600:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141917.059019:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141917.059098:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38077dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e7fc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059168:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059182:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059195:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059208:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059228:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059237:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059311:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059318:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059324:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059331:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141917.059335:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059341:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059353:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:2.0:1783141917.059356:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.059361:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059367:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38077e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059379:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059390:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059395:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059400:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141917.059402:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059407:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059414:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f9b4218b800) 00010000:00010000:2.0:1783141917.059416:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.059418:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059423:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38077ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059453:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38077dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7fc expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059463:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:2.0:1783141917.059466:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.059469:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a38077dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7fc expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.059478:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0000, rc 0) 00000100:00100000:2.0:1783141917.059537:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:12202:x1869759501113600:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 540us (756us total) trans 0 rc 301/301 00000100:00100000:2.0:1783141917.059544:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 153 00000100:00080000:3.0:1783141917.059938:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141917.066243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.066456:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113856 00000100:00100000:3.0:1783141917.066466:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113856 00000100:00100000:3.0:1783141917.066519:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00100000:3.0:1783141917.066528:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:12202:x1869759501113856:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1783141917.066578:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141917.066602:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e620 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.066617:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:3.0:1783141917.066622:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141917.066675:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.066698:0:11334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.066707:0:11334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.066739:0:11334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.066751:0:11334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 5 pid: 6523 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141917.066868:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521101056:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141917.066979:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141917.071387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.071409:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521101056:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141917.071435:0:11334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141917.071759:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501113984 00000100:00100000:1.0:1783141917.071767:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501113984 00010000:00010000:1.0:1783141917.071825:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 6 pid: 6523 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141917.071865:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:1.0:1783141917.071874:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2400:x1869759501113984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141917.071887:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141917.071894:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 6 pid: 6523 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.071904:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 6 pid: 6523 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.071935:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38077b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7ee expref: 6 pid: 6523 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.071948:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:1.0:1783141917.071953:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.071962:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.071981:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.072008:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141917.072017:0:11334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072039:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141917.072057:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2400:x1869759501113984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.072066:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00010000:00010000:0.0:1783141917.072075:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072088:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072098:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783141917.072376:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783141917.072718:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072729:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072736:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141917.072750:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000102b17de reply state 00000000d62aed69 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072771:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072779:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141917.072781:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141917.072784:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783141917.072789:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783141917.072804:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072811:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072818:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072824:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cdc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141917.072828:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072835:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072844:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b4246ec00) 00010000:00010000:0.0:1783141917.072847:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141917.072851:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072857:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a38077f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141917.072879:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000102b17de reply state 00000000d62aed69 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072896:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.072901:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141917.072904:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141917.072920:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783141917.072989:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:12202:x1869759501113856:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 6460us (6754us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1783141917.072998:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00100000:0.0:1783141917.147841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.148163:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114112 00000100:00100000:3.0:1783141917.148174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114112 00000100:00100000:3.0:1783141917.148236:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 155 00000100:00100000:3.0:1783141917.148245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+15:12210:x1869759501114112:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:3.0:1783141917.148555:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.148578:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e803 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148661:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148674:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148685:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.148727:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783141917.148731:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141917.148750:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148773:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e803 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148791:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e803 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.148799:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141917.148802:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141917.148806:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd600, rc 0) 00000100:00100000:3.0:1783141917.148873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:12210:x1869759501114112:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 628us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.148881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 155 00000100:00100000:1.0:1783141917.207023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.210291:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114240 00000100:00100000:2.0:1783141917.210307:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114240 00000100:00100000:3.0:1783141917.215964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 156 00000100:00100000:3.0:1783141917.215978:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+16:12216:x1869759501114240:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141917.216012:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.216032:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e80a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216093:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216106:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216117:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216128:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216136:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216142:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216216:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216225:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216232:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.216266:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783141917.216292:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141917.216315:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216327:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216333:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216680:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216687:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cdc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141917.216691:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216698:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216711:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141917.216714:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141917.216718:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216724:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a380781b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216738:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216744:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216759:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216765:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cce00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141917.216768:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216774:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216781:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f9c7b5c1600) 00010000:00010000:3.0:1783141917.216784:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141917.216786:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216791:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807822 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216817:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a3807814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e80a expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216829:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e80a expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.216836:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141917.216837:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783141917.216840:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cde00, rc 0) 00000100:00100000:3.0:1783141917.216900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:12216:x1869759501114240:12345-192.168.203.39@tcp:101:bash.0 Request processed in 924us (9886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.216926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 156 00000100:00100000:1.0:1783141917.222227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.222686:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114496 00000100:00100000:0.0:1783141917.222698:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114496 00000100:00100000:0.0:1783141917.222766:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 157 00000100:00100000:0.0:1783141917.222776:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+17:12216:x1869759501114496:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141917.222799:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141917.222820:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807830 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e811 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.222938:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.222956:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.222968:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.223026:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.223034:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.223041:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141917.223636:0:11334:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783141917.223773:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.223784:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.223793:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224884:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224897:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224904:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224918:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141917.224922:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224930:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224944:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141917.224948:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141917.224953:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.224976:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807837 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141917.224993:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000586c6e58 reply state 00000000cc1a2743 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.225006:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.225013:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:1.0:1783141917.225016:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141917.225018:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783141917.225063:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807830 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 20 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.225079:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.225087:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:1.0:1783141917.225089:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141917.225092:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:1.0:1783141917.225174:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:12216:x1869759501114496:12345-192.168.203.39@tcp:101:bash.0 Request processed in 2398us (2956us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783141917.225183:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 157 00000100:00100000:0.0:1783141917.228943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.229020:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114624 00000100:00100000:3.0:1783141917.229030:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114624 00000100:00100000:3.0:1783141917.229141:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:3.0:1783141917.229152:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501114624:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141917.229168:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.229186:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e818 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141917.229211:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783141917.229229:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1783141917.229234:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141917.229242:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.229304:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.229318:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd200, rc 0) 00000100:00100000:3.0:1783141917.229386:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501114624:12345-192.168.203.39@tcp:101:bash.0 Request processed in 235us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.229393:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00080000:0.0:1783141917.236649:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141917.242658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.245568:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114752 00000100:00100000:3.0:1783141917.245583:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114752 00000100:00100000:3.0:1783141917.245719:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1783141917.245729:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:12216:x1869759501114752:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141917.245759:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.245777:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e81f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.245807:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.245817:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141917.245821:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141917.245827:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.245860:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.245872:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141917.245885:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521101184:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141917.246006:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141917.248309:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521101184:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141917.248340:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.248362:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cda00, rc 0) 00000100:00100000:3.0:1783141917.248538:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:12216:x1869759501114752:12345-192.168.203.39@tcp:101:bash.0 Request processed in 2809us (5888us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.248548:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:1.0:1783141917.257613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.257714:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501114880 00000100:00100000:0.0:1783141917.257723:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501114880 00010000:00010000:0.0:1783141917.257764:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.257829:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:0.0:1783141917.257839:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501114880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141917.257855:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141917.257874:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.257888:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.257921:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043044eda/0xb31399d6a3807853 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e818 expref: 7 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.257952:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141917.257956:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141917.257964:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.257974:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.258026:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.258041:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9526:1869759521101312:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783141917.258131:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141917.262320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.262404:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501115136 00000100:00100000:3.0:1783141917.262422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501115136 00000100:00100000:3.0:1783141917.262479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783141917.262490:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:12216:x1869759501115136:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:3.0:1783141917.262797:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12216:x1869759501115136:12345-192.168.203.39@tcp:35:bash.0 Request processed in 308us (483us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1783141917.262805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:0.0:1783141917.263143:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9526:1869759521101312:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783141917.263162:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141917.263200:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501114880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5362us (5596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141917.263209:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:1.0:1783141917.350727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.350961:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501115392 00000100:00100000:3.0:1783141917.350972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501115392 00000100:00100000:3.0:1783141917.351085:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00100000:3.0:1783141917.351096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12226:x1869759501115392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.351121:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.351142:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e826 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.351257:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783141917.351563:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807861 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e826 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.351579:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141917.351582:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141917.351587:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a3807861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e826 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.351680:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cce00, rc 0) 00000100:00100000:3.0:1783141917.351792:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:12226:x1869759501115392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 697us (2468us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1783141917.351801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00100000:2.0:1783141917.355373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.355804:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501115648 00000100:00100000:3.0:1783141917.355815:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501115648 00000100:00100000:3.0:1783141917.355868:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:3.0:1783141917.355878:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:12226:x1869759501115648:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783141917.356119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:12226:x1869759501115648:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 241us (766us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1783141917.356127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1783141917.444971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.445141:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141917.445159:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521101440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141917.445220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141917.445614:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521101440 00000100:00100000:1.0:1783141917.445623:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521101440 00000100:00100000:1.0:1783141917.445674:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783141917.445683:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521101440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141917.445711:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783141917.445757:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521101440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.445764:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783141917.445952:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521101440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141917.446131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501115776 00000100:00100000:3.0:1783141917.446135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501115776 00000100:00100000:3.0:1783141917.446174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:3.0:1783141917.446181:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:12232:x1869759501115776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.446243:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.446262:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a380786f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e82d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446559:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446574:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446584:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.446748:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783141917.446752:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141917.446896:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446935:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a380786f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e82d expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446953:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e82d expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.446962:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141917.446965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141917.446969:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cdc00, rc 0) 00000100:00100000:3.0:1783141917.447061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:12232:x1869759501115776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 879us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.447069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:3.0:1783141917.453936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.454128:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116032 00000100:00100000:2.0:1783141917.454137:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116032 00000100:00100000:2.0:1783141917.454194:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:2.0:1783141917.454205:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:12232:x1869759501116032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141917.454224:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141917.454243:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380787d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e834 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.454393:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.454504:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.454518:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141917.454530:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783141917.454657:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a380787d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e834 expref: 27 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.454677:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e834 expref: 26 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.454686:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:2.0:1783141917.454689:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141917.454692:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783141917.454743:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12232:x1869759501116032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 540us (817us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783141917.454751:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:2.0:1783141917.459194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.459261:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116288 00000100:00100000:3.0:1783141917.459301:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116288 00000100:00100000:3.0:1783141917.459365:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:3.0:1783141917.459375:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12232:x1869759501116288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.459398:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.459549:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807892 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e83b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.459658:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.459683:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.459695:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.459707:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783141917.459937:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a3807892 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e83b expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.459955:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e83b expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.459963:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:3.0:1783141917.459966:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783141917.459969:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd200, rc 0) 00000100:00100000:3.0:1783141917.460027:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:12232:x1869759501116288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 652us (841us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1783141917.460033:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:0.0:1783141917.466510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.466554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.466724:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116544 00000100:00100000:3.0:1783141917.466733:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116544 00000100:00100000:3.0:1783141917.466795:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:3.0:1783141917.466804:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2402:x1869759501116544:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:3.0:1783141917.466845:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.466863:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.466892:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141917.466896:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141917.466902:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.466943:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.466956:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 6 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141917.466971:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521101568:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141917.467064:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141917.468130:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116416 00000100:00100000:1.0:1783141917.468140:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116416 00000100:00100000:1.0:1783141917.468188:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783141917.468197:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:2403:x1869759501116416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141917.468210:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141917.468232:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e834 expref: 28 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.468258:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:1.0:1783141917.468293:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141917.468341:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:2403:x1869759501116416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.468348:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:0.0:1783141917.477240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.477589:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1869759521101568:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141917.477626:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141917.477758:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116672 00000100:00100000:1.0:1783141917.477767:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116672 00002000:00100000:1.0:1783141917.477812:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f9b441e2d80 x1869759501116672/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:293/0 lens 504/0 e 0 to 0 dl 1783141928 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141917.477820:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b441e2d80 with x1869759501116672 ext(0->12) 00010000:00010000:1.0:1783141917.477828:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 7 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.477854:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 7 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141917.477862:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9b441e2d80 00000100:00100000:1.0:1783141917.477896:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1783141917.477914:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501116672:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1783141917.479001:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501116672:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 1090us (1766us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783141917.479013:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00002000:00100000:1.0:1783141917.479024:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f9b441e2d80 x1869759501116672/t4294967306(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:293/0 lens 504/448 e 0 to 0 dl 1783141928 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141917.479033:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b441e2d80 with x1869759501116672 ext(0->12) 00010000:00010000:1.0:1783141917.479041:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.479055:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141917.479062:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9b441e2d80 00000100:00100000:2.0:1783141917.481850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141917.481947:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501116800 00000100:00100000:1.0:1783141917.481957:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501116800 00010000:00010000:1.0:1783141917.481993:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141917.482051:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:1.0:1783141917.482060:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2400:x1869759501116800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141917.482074:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783141917.482090:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783141917.482092:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783141917 00002000:00010000:1.0:1783141917.482095:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783141918 00002000:00010000:1.0:1783141917.482097:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783141917 00002000:00010000:1.0:1783141917.482099:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783141917.482104:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.482118:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.482139:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000852944dc/0xb31399d6a380785a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e81f expref: 9 pid: 8438 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.482156:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141917.482160:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141917.482166:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.482175:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.482315:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141917.482374:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2400:x1869759501116800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 314us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.482382:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00010000:00010000:0.0:1783141917.482958:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.482983:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483004:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483013:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483021:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483028:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cce00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141917.483033:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483042:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483055:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.483063:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d20f4ad/0xb31399d6a38078a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.483129:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501116544:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 16325us (16574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141917.483137:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:1.0:1783141917.486222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.486698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117056 00000100:00100000:3.0:1783141917.486708:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117056 00000100:00100000:3.0:1783141917.486795:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783141917.486806:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12232:x1869759501117056:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1783141917.486864:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e83b expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141917.487200:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783141917.487234:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1783141917.488252:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1783141917.488772:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.488790:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 31 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.488799:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.488834:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 31 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.488847:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 31 pid: 11334 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141917.488960:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869759521101696:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141917.489091:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad3900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141917.494018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.494133:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117184 00000100:00100000:3.0:1783141917.494142:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117184 00010000:00010000:3.0:1783141917.494180:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 32 pid: 11334 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141917.494219:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:3.0:1783141917.494229:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:2403:x1869759501117184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141917.494244:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141917.494251:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 32 pid: 11334 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.494294:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 32 pid: 11334 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.494316:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:3.0:1783141917.494322:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.494331:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.494338:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.494361:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141917.494422:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:2403:x1869759501117184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 183us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.494443:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00010000:00010000:2.0:1783141917.496680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e811 expref: 31 pid: 11334 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141917.496703:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869759521101696:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141917.496727:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.496736:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.496742:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141917.496841:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1783141917.496960:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1783141917.497048:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869759521101824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783141917.497106:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141917.497184:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141917.497224:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521101824 00000100:00100000:1.0:1783141917.497230:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521101824 00000100:00100000:1.0:1783141917.497583:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783141917.497594:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1869759521101824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783141917.498013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1869759521101824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 419us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.498022:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783141917.498100:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869759521101824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783141917.498220:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:3.0:1783141917.498490:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869759521101952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783141917.498526:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141917.498583:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141917.498734:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521101952 00000100:00100000:1.0:1783141917.498739:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521101952 00000100:00100000:1.0:1783141917.498777:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783141917.498784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1869759521101952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783141917.498897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1869759521101952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (370us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783141917.498904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783141917.498997:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869759521101952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783141917.499036:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1783141917.499068:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499078:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499086:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499092:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141917.499096:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499104:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499120:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:0.0:1783141917.499123:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783141917.499128:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.499134:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ae lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141917.499235:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783141917.499320:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1783141917.499332:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428566059516ns, next at 429566057364ns, rc = 0 00000001:00080000:0.0:1783141917.499339:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1783141917.499475:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:0.0:1783141917.499479:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141917.499486:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a3807899 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e83b expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.499635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:12232:x1869759501117056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 12830us (13420us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1783141917.499643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000020:00080000:0.0:1783141917.499648:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783141917.502208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.502535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117312 00000100:00100000:3.0:1783141917.502545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117312 00000100:00100000:3.0:1783141917.502728:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:3.0:1783141917.502739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:12232:x1869759501117312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.502760:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.502781:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a38078b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e842 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.502833:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a38078b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e842 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.502847:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a38078b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e842 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.502866:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141917.502869:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141917.502872:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cca00, rc 0) 00000100:00100000:3.0:1783141917.502940:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:12232:x1869759501117312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 202us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.502948:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:1.0:1783141917.507047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.507133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117568 00000100:00100000:0.0:1783141917.507143:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117568 00000100:00100000:0.0:1783141917.507193:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:0.0:1783141917.507203:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:12232:x1869759501117568:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141917.507542:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:12232:x1869759501117568:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 339us (501us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1783141917.507551:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00010000:00010000:2.0:1783141917.573071:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141917.582652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.582925:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117824 00000100:00100000:3.0:1783141917.582935:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117824 00000100:00100000:3.0:1783141917.582999:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:3.0:1783141917.583009:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+36:12242:x1869759501117824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.583035:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.583058:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a38078bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e849 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141917.583158:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783141917.583252:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a38078bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e849 expref: 38 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.583313:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141917.583317:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141917.583322:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a38078bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e849 expref: 38 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.583336:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b424cd200, rc 0) 00000100:00100000:3.0:1783141917.583739:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12242:x1869759501117824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 731us (1095us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1783141917.583747:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:1.0:1783141917.586757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.587159:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501117952 00000100:00100000:2.0:1783141917.587170:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501117952 00000100:00100000:2.0:1783141917.587291:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:2.0:1783141917.587303:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12242:x1869759501117952:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783141917.587516:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587545:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587557:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587569:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587576:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587583:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587726:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587735:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587743:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141917.587788:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587801:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587808:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587826:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587832:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141917.587836:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587844:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587857:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141917.587860:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.587864:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587870:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a38078ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587894:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587901:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587915:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587921:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141917.587924:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587941:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587949:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:2.0:1783141917.587952:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.587955:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587961:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a38078d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587978:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587984:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587989:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.587995:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141917.587997:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.588003:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.588010:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141917.588012:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141917.588015:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.588029:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38078d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141917.588160:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12242:x1869759501117952:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 858us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141917.588168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:1.0:1783141917.590976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.591210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501118208 00000100:00100000:0.0:1783141917.591220:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501118208 00000100:00100000:0.0:1783141917.591356:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:0.0:1783141917.591367:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12242:x1869759501118208:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141917.591572:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:12242:x1869759501118208:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 206us (603us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783141917.591580:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:0.0:1783141917.632752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.632953:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501118464 00000100:00100000:3.0:1783141917.632962:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501118464 00000100:00100000:3.0:1783141917.633021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:3.0:1783141917.633031:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:12245:x1869759501118464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141917.633055:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141917.633075:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a38078df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e850 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633165:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633179:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633200:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633206:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.633213:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.633826:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.633839:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.633846:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141917.633858:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783141917.633979:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.633987:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.633993:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634000:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cce00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141917.634004:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634012:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141917.634036:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141917.634042:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634049:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cce00/0xb31399d6a38078e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634064:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634070:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634076:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634081:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b424cda00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141917.634083:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634090:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634097:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:0.0:1783141917.634100:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141917.634104:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634108:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cda00/0xb31399d6a38078ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634148:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd200/0xb31399d6a38078df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634174:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.634182:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141917.634185:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141917.634187:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f200, rc 0) 00000100:00100000:0.0:1783141917.634262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12245:x1869759501118464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1225us (1510us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783141917.634347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:1.0:1783141917.636691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.636834:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501118592 00000100:00100000:3.0:1783141917.636843:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501118592 00000100:00100000:3.0:1783141917.636899:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:3.0:1783141917.636917:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12245:x1869759501118592:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783141917.636976:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.636992:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637002:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637051:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637058:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637065:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637070:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141917.637074:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637081:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637093:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141917.637096:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141917.637099:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141917.637106:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141917.637187:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12245:x1869759501118592:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 280us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.637195:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:1.0:1783141917.641893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.642102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501118848 00000100:00100000:3.0:1783141917.642113:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501118848 00000100:00100000:3.0:1783141917.642169:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783141917.642195:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12245:x1869759501118848:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783141917.642600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:12245:x1869759501118848:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 406us (716us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783141917.642679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:0.0:1783141917.879183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.879306:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501119104 00000100:00100000:2.0:1783141917.879315:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501119104 00000100:00100000:2.0:1783141917.879377:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:2.0:1783141917.879386:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:12276:x1869759501119104:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1783141917.879408:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141917.879425:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807909 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e857 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.879517:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.879531:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.879542:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141917.879552:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783141917.879645:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807909 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e857 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.879672:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e857 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.879690:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141917.879693:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141917.879696:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1800, rc 0) 00000100:00100000:2.0:1783141917.879758:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12276:x1869759501119104:12345-192.168.203.39@tcp:101:cat.0 Request processed in 372us (582us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1783141917.879765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:1.0:1783141917.883669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141917.883794:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501119360 00000100:00100000:0.0:1783141917.883803:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501119360 00000100:00100000:0.0:1783141917.883863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783141917.883872:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12276:x1869759501119360:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:0.0:1783141917.884162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:12276:x1869759501119360:12345-192.168.203.39@tcp:35:cat.0 Request processed in 290us (500us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1783141917.884170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783141917.884481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141917.890517:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501119488 00000100:00100000:3.0:1783141917.890532:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501119488 00000100:00100000:2.0:1783141917.894078:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783141917.894093:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:2401:x1869759501119488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141917.894110:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141917.894137:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e857 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.894167:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141917.894171:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141917.898098:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:2401:x1869759501119488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3996us (13605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141917.898113:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:1.0:1783141917.930265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.931349:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501119744 00000100:00100000:2.0:1783141917.931361:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501119744 00000100:00100000:2.0:1783141917.931427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 168 00000100:00100000:2.0:1783141917.931436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12282:x1869759501119744:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783141917.931458:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141917.931462:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141917.931488:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cdc00/0xb31399d6a3807876 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e82d expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931529:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141917.931535:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141917.931549:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a380791e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e85e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931650:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931663:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931672:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931705:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.931722:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 43 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141917.931737:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521102080:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141917.931834:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141917.934605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.934691:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521102080:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141917.934718:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.934874:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501119872 00000100:00100000:0.0:1783141917.934881:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501119872 00010000:00010000:0.0:1783141917.934932:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 44 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.934967:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:0.0:1783141917.934977:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:2402:x1869759501119872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141917.935004:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141917.935011:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 44 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935022:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 44 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935041:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a38078f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e850 expref: 44 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935054:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141917.935058:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935067:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935074:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141917.935096:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141917.935120:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.935136:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141917.935147:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:2402:x1869759501119872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 170us (549us total) trans 0 rc 0/0 00000004:00200000:2.0:1783141917.935155:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:0.0:1783141917.935156:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00010000:00010000:2.0:1783141917.935514:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a380791e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.935541:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.935549:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141917.935551:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141917.935554:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783141917.935634:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12282:x1869759501119744:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4198us (5388us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1783141917.935642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 168 00000100:00100000:3.0:1783141917.938072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141917.938180:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501120000 00000100:00100000:1.0:1783141917.938190:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501120000 00000100:00100000:1.0:1783141917.938268:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:1.0:1783141917.938303:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12282:x1869759501120000:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1783141917.938328:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141917.938347:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807933 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e865 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938392:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938406:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938416:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938525:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807933 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 45 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938544:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 44 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141917.938552:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141917.938555:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141917.938558:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:1.0:1783141917.938616:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:12282:x1869759501120000:12345-192.168.203.39@tcp:101:dd.0 Request processed in 315us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141917.938632:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:0.0:1783141917.943549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141917.944094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501120256 00000100:00100000:2.0:1783141917.944104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501120256 00000100:00100000:2.0:1783141917.944170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:2.0:1783141917.944180:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:12282:x1869759501120256:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1783141917.944434:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.944451:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.944462:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141917.944525:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1783141917.944549:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4203b8d reply state 00000000c8438531 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.944562:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141917.944570:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141917.944573:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783141917.944576:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141917.947035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:12282:x1869759501120256:12345-192.168.203.39@tcp:36:dd.0 Request processed in 2847us (3484us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783141917.947047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 170 00000020:00080000:2.0:1783141917.947054:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783141917.959815:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521102208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141917.959884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141917.959980:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521102208 00000100:00100000:3.0:1783141917.959987:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521102208 00000100:00100000:3.0:1783141917.960043:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783141917.960052:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521102208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783141917.960075:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783141917.960787:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521102208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 732us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141917.960795:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783141917.960860:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521102208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783141918.213948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.214043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501120384 00000100:00100000:2.0:1783141918.214054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501120384 00000100:00100000:2.0:1783141918.214175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:2.0:1783141918.214185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:12296:x1869759501120384:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1783141918.214211:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.214232:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807948 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e86c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214328:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214361:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214372:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214384:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214391:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214397:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214477:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214489:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214498:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214528:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.214541:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 48 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141918.214567:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521102336:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141918.214679:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141918.217745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.217877:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521102336:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141918.217914:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141918.218076:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501120640 00000100:00100000:0.0:1783141918.218083:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501120640 00000100:00100000:0.0:1783141918.218184:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1783141918.218208:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:6169:x1869759501120640:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783141918.218533:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:6169:x1869759501120640:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 326us (796us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1783141918.218542:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1783141918.222590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141918.222679:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501120768 00000100:00100000:1.0:1783141918.222688:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501120768 00010000:00010000:1.0:1783141918.222728:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 50 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141918.222772:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:1.0:1783141918.222782:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:2402:x1869759501120768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141918.222797:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141918.222803:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 50 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222817:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 50 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222837:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807925 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e85e expref: 50 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222862:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141918.222866:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222876:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222884:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.222953:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141918.223007:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+49:2402:x1869759501120768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 225us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141918.223014:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00010000:00010000:2.0:1783141918.223240:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223249:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.223327:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783141918.223332:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141918.223351:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223363:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223372:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223379:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223385:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223391:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141918.223401:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223409:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223419:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141918.223422:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141918.223425:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223431:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380794f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223452:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223459:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223465:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223470:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141918.223472:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223477:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223484:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:2.0:1783141918.223486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141918.223495:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223501:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807956 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223530:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807948 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e86c expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223545:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e86c expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.223552:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.223554:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141918.223556:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0200, rc 0) 00000100:00100000:2.0:1783141918.223921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:12296:x1869759501120384:12345-192.168.203.39@tcp:101:stat.0 Request processed in 9736us (9981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141918.223930:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:2.0:1783141918.280236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141918.280434:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501121024 00000100:00100000:1.0:1783141918.280444:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501121024 00000100:00100000:1.0:1783141918.280541:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:1.0:1783141918.280552:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:12302:x1869759501121024:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:1.0:1783141918.280607:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141918.280635:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a380795d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e86c expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.280654:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141918.280659:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141918.280821:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.280836:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.280846:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141918.280885:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1783141918.280924:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000485add9c reply state 0000000028f84e28 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.280937:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141918.280958:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141918.280960:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141918.280963:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141918.281058:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:12302:x1869759501121024:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 508us (830us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783141918.281067:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 172 00000020:00080000:1.0:1783141918.281072:0:11334:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783141918.402757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.403470:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501121152 00000100:00100000:3.0:1783141918.403480:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501121152 00000100:00100000:3.0:1783141918.403590:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:3.0:1783141918.403599:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+50:12316:x1869759501121152:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:3.0:1783141918.403621:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141918.403638:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a380796b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e873 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403707:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403739:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403749:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403760:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403766:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403772:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403836:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403845:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403851:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141918.403888:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1783141918.403892:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141918.403926:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403937:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403957:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403972:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403979:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403984:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141918.403988:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.403995:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404007:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141918.404010:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141918.404013:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404019:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404032:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404037:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404042:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404053:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141918.404056:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404062:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404071:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:3.0:1783141918.404073:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141918.404076:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404082:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404108:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a380796b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 52 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404121:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 51 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.404128:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141918.404130:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141918.404132:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2800, rc 0) 00000100:00100000:3.0:1783141918.404208:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:12316:x1869759501121152:12345-192.168.203.39@tcp:101:stat.0 Request processed in 610us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141918.404215:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:0.0:1783141918.488810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.491486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501121408 00000100:00100000:2.0:1783141918.491499:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501121408 00000100:00100000:2.0:1783141918.491576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:2.0:1783141918.491586:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+51:12326:x1869759501121408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141918.491607:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.491625:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e87a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.491717:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783141918.491807:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807987 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e87a expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.491835:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:2.0:1783141918.491839:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141918.491855:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e87a expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.491872:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783141918.491957:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:12326:x1869759501121408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 372us (3158us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1783141918.491965:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:2.0:1783141918.496354:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141918.496488:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501121664 00000100:00100000:0.0:1783141918.496498:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501121664 00000100:00100000:0.0:1783141918.496553:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:0.0:1783141918.496562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:12326:x1869759501121664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141918.496766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:12326:x1869759501121664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 204us (419us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783141918.496774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783141918.568325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.568479:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501121920 00000100:00100000:2.0:1783141918.568489:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501121920 00000100:00100000:2.0:1783141918.568548:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 175 00000100:00100000:2.0:1783141918.568559:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+53:12332:x1869759501121920:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141918.568583:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.568604:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807995 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e881 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.568709:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.568725:0:11334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 54 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.568735:0:11334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.568783:0:11334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 54 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.568797:0:11334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 54 pid: 7934 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141918.568810:0:11334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521102464:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141918.568915:0:11334:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141918.576028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.576064:0:11334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11334:1869759521102464:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141918.576095:0:11334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141918.576128:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501122048 00000100:00100000:0.0:1783141918.576136:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501122048 00010000:00010000:0.0:1783141918.576171:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 55 pid: 7934 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141918.576211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:0.0:1783141918.576220:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:2402:x1869759501122048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141918.576236:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141918.576244:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 55 pid: 7934 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576257:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 55 pid: 7934 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576325:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807980 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e873 expref: 55 pid: 7934 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576340:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141918.576345:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576355:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576363:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141918.576388:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141918.576430:0:11334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141918.576433:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:2402:x1869759501122048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 213us (414us total) trans 0 rc 0/0 00010000:00010000:2.0:1783141918.576447:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141918.576450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000004:00200000:2.0:1783141918.576471:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783141918.576590:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807995 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 55 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.576608:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 54 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.576615:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.576618:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141918.576627:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0400, rc 0) 00000100:00100000:2.0:1783141918.576655:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:12332:x1869759501121920:12345-192.168.203.39@tcp:101:bash.0 Request processed in 8098us (8338us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1783141918.576663:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 175 00000100:00100000:0.0:1783141918.585098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.585208:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501122304 00000100:00100000:3.0:1783141918.585231:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501122304 00000100:00100000:3.0:1783141918.585321:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 176 00000100:00100000:3.0:1783141918.585332:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:12332:x1869759501122304:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:3.0:1783141918.585540:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.585556:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.585567:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141918.585606:0:7934:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1783141918.585625:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a84a6ea reply state 000000002dd9058a transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.585637:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.585645:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141918.585647:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141918.585651:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141918.586045:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:12332:x1869759501122304:12345-192.168.203.39@tcp:36:bash.0 Request processed in 714us (955us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783141918.586053:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 176 00000020:00080000:3.0:1783141918.586058:0:7934:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783141918.593180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.593265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501122432 00000100:00100000:3.0:1783141918.593298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501122432 00000100:00100000:3.0:1783141918.593356:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 177 00000100:00100000:3.0:1783141918.593365:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:12332:x1869759501122432:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141918.593406:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141918.593425:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e888 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.593509:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.593525:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 58 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.593533:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.593564:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 58 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.593576:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 58 pid: 11334 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141918.593589:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521102592:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141918.593671:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141918.595762:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521102592:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141918.595785:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596416:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141918.596687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.596750:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501122560 00000100:00100000:3.0:1783141918.596756:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501122560 00010000:00010000:3.0:1783141918.596797:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 59 pid: 11334 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141918.596834:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1783141918.596842:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:2402:x1869759501122560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141918.596870:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141918.596877:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 59 pid: 11334 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596889:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 59 pid: 11334 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596919:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a380799c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e881 expref: 59 pid: 11334 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596935:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141918.596940:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596949:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596957:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.596988:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141918.597038:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:2402:x1869759501122560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 196us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141918.597046:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00010000:00010000:2.0:1783141918.597117:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.597126:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.597176:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783141918.597181:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141918.597200:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.597227:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e888 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.597242:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e888 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.597249:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.597252:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141918.597254:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:2.0:1783141918.597319:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:12332:x1869759501122432:12345-192.168.203.39@tcp:101:bash.0 Request processed in 3955us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141918.597326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 177 00000100:00100000:1.0:1783141918.604627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141918.605476:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501122816 00000100:00100000:0.0:1783141918.605486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501122816 00000100:00100000:0.0:1783141918.605543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783141918.605553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+57:12332:x1869759501122816:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783141918.605757:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12332:x1869759501122816:12345-192.168.203.39@tcp:35:bash.0 Request processed in 205us (1138us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1783141918.605765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783141918.720768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.720865:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123072 00000100:00100000:2.0:1783141918.720874:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123072 00000100:00100000:2.0:1783141918.720951:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 178 00000100:00100000:2.0:1783141918.720975:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12342:x1869759501123072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141918.720999:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.721019:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38079bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e88f expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.721113:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783141918.721205:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38079bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e88f expref: 60 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.721219:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:2.0:1783141918.721236:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141918.721241:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38079bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e88f expref: 60 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.721265:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783141918.721460:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12342:x1869759501123072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 486us (699us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1783141918.721468:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 178 00000100:00100000:1.0:1783141918.727170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.727257:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123200 00000100:00100000:3.0:1783141918.727266:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123200 00000100:00100000:3.0:1783141918.727433:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:3.0:1783141918.727443:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12342:x1869759501123200:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1783141918.727516:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727532:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727543:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727553:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727559:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727565:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727634:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727644:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727651:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141918.727694:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727720:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727726:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727732:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727737:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141918.727742:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727748:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727760:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141918.727763:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141918.727766:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727772:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a38079cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727786:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727792:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727797:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727809:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141918.727812:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727818:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727826:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:3.0:1783141918.727828:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141918.727831:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727836:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a38079d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727845:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727851:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727857:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727862:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141918.727864:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727871:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.727996:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141918.727998:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141918.728001:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.728007:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a38079db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141918.728116:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12342:x1869759501123200:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 673us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141918.728124:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:1.0:1783141918.735713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141918.740462:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123456 00000100:00100000:0.0:1783141918.740494:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123456 00000100:00100000:0.0:1783141918.740622:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783141918.740632:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12342:x1869759501123456:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141918.740851:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:12342:x1869759501123456:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 219us (5145us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1783141918.740859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783141918.774911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.775186:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123712 00000100:00100000:2.0:1783141918.775197:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123712 00000100:00100000:2.0:1783141918.775261:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:2.0:1783141918.775304:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:12345:x1869759501123712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141918.775328:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.775348:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38079e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e896 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775417:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775444:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775455:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775467:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775482:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775578:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38079f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775589:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38079f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775597:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38079f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.775607:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783141918.775676:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775684:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775691:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775703:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141918.775708:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775716:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775729:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141918.775732:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141918.775736:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775743:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38079e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775764:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775771:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775778:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775783:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141918.775786:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775793:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775810:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:2.0:1783141918.775813:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141918.775816:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.775822:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a38079f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.776181:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38079e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e896 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.776198:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38079f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e896 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.776206:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.776209:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141918.776212:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:2.0:1783141918.776313:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:12345:x1869759501123712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1043us (1426us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1783141918.776323:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:1.0:1783141918.781054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141918.781097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.781164:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123840 00000100:00100000:2.0:1783141918.781173:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123840 00000100:00100000:2.0:1783141918.781230:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:2.0:1783141918.781241:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:12345:x1869759501123840:12345-192.168.203.39@tcp:54:lfs.0 00000100:00100000:3.0:1783141918.781259:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501123968 00000100:00100000:3.0:1783141918.781265:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501123968 00000100:00100000:3.0:1783141918.781329:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:3.0:1783141918.781338:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:2400:x1869759501123968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141918.781344:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.781360:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141918.781364:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.781450:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784756:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784772:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784780:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784796:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141918.784801:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.784805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a38079f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e896 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784812:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.784827:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.784831:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141918.784835:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.784836:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.784843:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141918.784847:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141918.785095:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:12345:x1869759501123840:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 3854us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141918.785106:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783141918.787543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:2400:x1869759501123968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6197us (6435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141918.787559:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:1.0:1783141918.792751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.792845:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501124224 00000100:00100000:2.0:1783141918.792855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501124224 00000100:00100000:2.0:1783141918.793040:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783141918.793050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+61:12345:x1869759501124224:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783141918.793493:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:12345:x1869759501124224:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 444us (750us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783141918.793501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:1.0:1783141918.935505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141918.935628:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501124480 00000100:00100000:3.0:1783141918.935637:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501124480 00000100:00100000:3.0:1783141918.935761:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:3.0:1783141918.935785:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+62:12363:x1869759501124480:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783141918.935809:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141918.935828:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e89d expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.935954:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.935968:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.935982:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141918.935994:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783141918.936095:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e89d expref: 65 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.936115:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e89d expref: 64 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141918.936124:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141918.936127:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783141918.936131:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:3.0:1783141918.936204:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12363:x1869759501124480:12345-192.168.203.39@tcp:101:cat.0 Request processed in 420us (708us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783141918.936211:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:0.0:1783141918.986500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.986586:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501124608 00000100:00100000:2.0:1783141918.986595:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501124608 00000100:00100000:2.0:1783141918.986647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:2.0:1783141918.986655:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12364:x1869759501124608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141918.986677:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141918.986695:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8a4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986755:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986769:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986779:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141918.986820:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783141918.986824:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141918.986842:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986868:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8a4 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986914:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8a4 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.986923:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141918.986927:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141918.986930:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0800, rc 0) 00000100:00100000:2.0:1783141918.986995:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12364:x1869759501124608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 338us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141918.987002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:1.0:1783141918.995585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141918.996020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501124992 00000100:00100000:0.0:1783141918.996031:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501124992 00000100:00100000:0.0:1783141918.996142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1783141918.996153:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12364:x1869759501124992:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141918.996641:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12364:x1869759501124992:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 488us (1063us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1783141918.996650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1783141918.998500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141918.998558:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125120 00000100:00100000:2.0:1783141918.998567:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125120 00000100:00100000:2.0:1783141918.998625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783141918.998634:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12364:x1869759501125120:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:2.0:1783141918.998649:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783141918.998671:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a38079b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e888 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.998691:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e89d expref: 65 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.998703:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cca00/0xb31399d6a38078b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e842 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141918.998712:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141918.998716:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141918.998824:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12364:x1869759501125120:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 190us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141918.998833:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783141919.002200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.002304:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125248 00000100:00100000:2.0:1783141919.002315:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125248 00000100:00100000:2.0:1783141919.002415:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 184 00000100:00100000:2.0:1783141919.002426:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12364:x1869759501125248:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:2.0:1783141919.002556:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.002573:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.002584:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141919.002675:0:11334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783141919.002758:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12364:x1869759501125248:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 333us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.002766:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 184 00000100:00080000:0.0:1783141919.003315:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141919.025179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.025309:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125376 00000100:00100000:3.0:1783141919.025320:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125376 00000100:00100000:3.0:1783141919.025409:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 185 00000100:00100000:3.0:1783141919.025421:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12366:x1869759501125376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141919.025443:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141919.025463:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8ab expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025541:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025556:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025567:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025578:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025584:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025590:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025656:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025665:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025671:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141919.025722:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783141919.025727:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141919.025745:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025756:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025765:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025771:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025778:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025784:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141919.025788:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025796:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025808:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141919.025811:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141919.025816:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025822:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807a3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025847:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025853:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025858:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025864:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141919.025867:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025872:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025880:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:3.0:1783141919.025883:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141919.025886:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.025892:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.027743:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 65 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.027764:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 64 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.027792:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141919.027795:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141919.027798:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:3.0:1783141919.027876:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12366:x1869759501125376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2456us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141919.027885:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 185 00000040:00080000:3.0:1783141919.044655:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141919.044665:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141919.044711:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783141919.044721:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141919.044854:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521102720:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141919.045037:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141919.050202:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521102720:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141919.050800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.051043:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125504 00000100:00100000:2.0:1783141919.051052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125504 00000100:00100000:2.0:1783141919.051110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 186 00000100:00100000:2.0:1783141919.051119:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12368:x1869759501125504:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141919.051150:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141919.051314:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12368:x1869759501125504:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 195us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.051323:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 186 00000100:00100000:1.0:1783141919.053639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.053736:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125632 00000100:00100000:0.0:1783141919.053746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125632 00000100:00100000:0.0:1783141919.053804:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:0.0:1783141919.053814:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12368:x1869759501125632:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783141919.053886:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.053912:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.053951:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.053995:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054003:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054010:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054046:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054053:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141919.054097:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783141919.054101:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141919.054113:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054124:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054130:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054148:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054506:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.054512:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054520:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054531:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:0.0:1783141919.054534:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.054538:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054544:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054555:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054561:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054566:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054570:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fc00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.054573:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054589:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054597:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9f9c7b5c1f00) 00010000:00010000:0.0:1783141919.054599:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.054602:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054607:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054622:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054628:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054633:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054637:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.054639:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054644:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.054652:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.054655:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.054670:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.054860:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12368:x1869759501125632:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 1045us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.054870:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:0.0:1783141919.062836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.062933:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501125888 00000100:00100000:3.0:1783141919.062944:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501125888 00000100:00100000:3.0:1783141919.063010:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:3.0:1783141919.063020:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12368:x1869759501125888:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141919.063042:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141919.063064:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8b2 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063190:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063205:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063228:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141919.063241:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783141919.063359:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063366:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063372:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063377:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141919.063382:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063388:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063401:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:3.0:1783141919.063403:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141919.063407:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063413:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063450:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a67 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8b2 expref: 66 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063469:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:3.0:1783141919.063471:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141919.063476:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8b2 expref: 66 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.063485:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3800, rc 0) 00000100:00100000:3.0:1783141919.063531:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501125888:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 512us (705us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1783141919.063538:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:1.0:1783141919.066775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.066871:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501126016 00000100:00100000:2.0:1783141919.066881:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501126016 00000100:00100000:2.0:1783141919.066949:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:2.0:1783141919.066959:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501126016:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141919.066996:0:11334:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141919.067108:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501126016:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 150us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.067115:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:1.0:1783141919.069809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.070065:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501126272 00000100:00100000:0.0:1783141919.070074:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501126272 00000100:00100000:0.0:1783141919.070130:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:0.0:1783141919.070141:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501126272:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141919.070315:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141919.070319:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141919.070406:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807a28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8a4 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.070427:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141919.070433:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141919.070447:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8b9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141919.070780:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783141919.070914:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.070928:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.070954:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.071003:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fc00/0xb31399d6a3807a7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8b9 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.071017:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8b9 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.071024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:0.0:1783141919.071027:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141919.071029:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e200, rc 0) 00000100:00100000:0.0:1783141919.071379:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12368:x1869759501126272:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1239us (1576us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783141919.071388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:0.0:1783141919.086076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.086197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501126528 00000100:00100000:2.0:1783141919.086207:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501126528 00000100:00100000:2.0:1783141919.086527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:2.0:1783141919.086538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12368:x1869759501126528:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141919.086593:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141919.086618:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807a83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8b9 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086636:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9c7b5c1f00) 00010000:00010000:2.0:1783141919.086647:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141919.086668:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086681:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086691:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086759:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086781:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086788:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086831:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086838:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086844:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086850:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.086854:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086862:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086870:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141919.086872:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141919.086876:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086881:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807a91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086910:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086923:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086929:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086933:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.086936:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086942:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086950:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x11432b2f (ffff9f9b4218b800) 00010000:00010000:2.0:1783141919.086952:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141919.086955:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.086961:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807a98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11432b2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.087040:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501126528:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 503us (971us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141919.087047:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:1.0:1783141919.089844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.089937:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501126656 00000100:00100000:3.0:1783141919.089947:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501126656 00000100:00100000:3.0:1783141919.090008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:3.0:1783141919.090018:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12368:x1869759501126656:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141919.090038:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141919.090061:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8c0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090095:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090109:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090121:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090222:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807a9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090249:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.090309:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:3.0:1783141919.090312:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783141919.090315:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2800, rc 0) 00000100:00100000:3.0:1783141919.090378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12368:x1869759501126656:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 361us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141919.090386:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:0.0:1783141919.093030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141919.093118:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501126912 00000100:00100000:1.0:1783141919.093141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501126912 00000100:00100000:1.0:1783141919.093210:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:1.0:1783141919.093220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12368:x1869759501126912:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783141919.093507:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.093525:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.093537:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141919.093701:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1783141919.093711:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430160437921ns, next at 431160435889ns, rc = 0 00000004:00010000:1.0:1783141919.093756:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e0bfb4d reply state 000000001fd8f95f transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.093769:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.093777:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:1.0:1783141919.093780:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783141919.093784:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141919.093874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12368:x1869759501126912:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 655us (851us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1783141919.093881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:1.0:1783141919.096965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.099599:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127040 00000100:00100000:2.0:1783141919.099613:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127040 00000100:00100000:2.0:1783141919.099685:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:2.0:1783141919.099696:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12368:x1869759501127040:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141919.099720:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141919.099754:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8c7 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.099812:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 69 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.099827:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 69 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.099846:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:2.0:1783141919.099850:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141919.099853:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1a00, rc 0) 00000100:00100000:2.0:1783141919.099917:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+69:12368:x1869759501127040:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 223us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.099925:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:0.0:1783141919.110647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.110986:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127168 00000100:00100000:2.0:1783141919.110996:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127168 00000100:00100000:2.0:1783141919.111084:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:2.0:1783141919.111095:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+6:2403:x1869759501127168:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783141919.111344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501127168:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 251us (706us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783141919.111353:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00080000:3.0:1783141919.111629:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141919.114012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.114972:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127424 00000100:00100000:2.0:1783141919.114983:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127424 00000100:00100000:2.0:1783141919.115041:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783141919.115051:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+69:12368:x1869759501127424:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783141919.115364:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12368:x1869759501127424:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 313us (1359us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1783141919.115389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:1.0:1783141919.121331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.121441:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127680 00000100:00100000:0.0:1783141919.121449:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127680 00000100:00100000:0.0:1783141919.121509:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 195 00000100:00100000:0.0:1783141919.121518:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12368:x1869759501127680:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783141919.121634:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12368:x1869759501127680:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 116us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.121642:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 195 00000100:00100000:1.0:1783141919.127398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.127597:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127808 00000100:00100000:2.0:1783141919.127606:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127808 00000100:00100000:2.0:1783141919.127682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:2.0:1783141919.127692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12368:x1869759501127808:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141919.127747:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141919.127766:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807abb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8ce expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.127831:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.127863:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.127875:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141919.127929:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141919.127950:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.127979:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807abb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ce expref: 72 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.128013:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ce expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.128023:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:2.0:1783141919.128050:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783141919.128054:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1400, rc 0) 00000100:00100000:2.0:1783141919.128578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12368:x1869759501127808:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 463us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.128589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:2.0:1783141919.130953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141919.131055:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501127936 00000100:00100000:1.0:1783141919.131087:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501127936 00000100:00100000:1.0:1783141919.131352:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:1.0:1783141919.131364:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501127936:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141919.131399:0:8865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141919.131420:0:8865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8d5 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141919.131445:0:8865:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48961f, blocks: 0x0 00010000:00010000:1.0:1783141919.131464:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1783141919.131469:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141919.131491:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 8 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.131520:0:8865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 8 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.131535:0:8865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2400, rc 0) 00000100:00100000:1.0:1783141919.131622:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501127936:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 261us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141919.131630:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:1.0:1783141919.137962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.139105:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128192 00000100:00100000:2.0:1783141919.139117:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128192 00000100:00100000:2.0:1783141919.139222:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00100000:2.0:1783141919.139233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12368:x1869759501128192:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141919.139372:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12368:x1869759501128192:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 140us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.139380:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00100000:2.0:1783141919.141932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.142007:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128320 00000100:00100000:3.0:1783141919.142016:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128320 00000100:00100000:3.0:1783141919.142069:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1783141919.142078:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:12368:x1869759501128320:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141919.142096:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141919.142114:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8dc expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.142142:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.142150:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141919.142163:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141919.142170:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.142215:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.142226:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141919.142239:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521102848:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141919.142339:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141919.144959:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1869759521102848:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141919.144992:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.145012:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3800, rc 0) 00000100:00100000:2.0:1783141919.145072:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:12368:x1869759501128320:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2994us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.145080:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1783141919.147732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.148924:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128448 00000100:00100000:0.0:1783141919.148935:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128448 00010000:00010000:0.0:1783141919.148978:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.149070:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:0.0:1783141919.149078:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501128448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141919.149093:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141919.149109:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.149119:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.149136:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807ac9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8d5 expref: 9 pid: 8865 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.149149:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141919.149152:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141919.149172:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.149182:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.149220:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.149244:0:6509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6509:1869759521102976:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783141919.149365:0:6509:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783141919.154385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.154496:0:6509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6509:1869759521102976:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783141919.154519:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141919.154576:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501128448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5496us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.154595:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:3.0:1783141919.155609:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128576 00000100:00100000:3.0:1783141919.155621:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128576 00002000:00100000:2.0:1783141919.155727:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f9b4420a300 x1869759501128576/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:295/0 lens 504/0 e 0 to 0 dl 1783141930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141919.155738:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b4420a300 with x1869759501128576 ext(0->8) 00002000:00010000:2.0:1783141919.155744:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b4420a300 00000100:00100000:2.0:1783141919.155773:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783141919.155781:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501128576:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783141919.158629:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2402:x1869759501128576:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 2839us (4243us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783141919.158643:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00002000:00100000:2.0:1783141919.158655:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f9b4420a300 x1869759501128576/t4294967315(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:295/0 lens 504/448 e 0 to 0 dl 1783141930 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141919.158665:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b4420a300 with x1869759501128576 ext(0->8) 00002000:00010000:2.0:1783141919.158672:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b4420a300 00000100:00100000:0.0:1783141919.162185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.162293:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128704 00000100:00100000:2.0:1783141919.162303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128704 00000100:00100000:2.0:1783141919.163008:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 198 00000100:00100000:2.0:1783141919.163020:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12368:x1869759501128704:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783141919.170637:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:2.0:1783141919.170654:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:0.0:1783141919.170757:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170769:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170777:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170782:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.170787:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170794:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170821:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f9c7b5c1600) 00010000:00010000:0.0:1783141919.170824:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.170829:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170834:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a38077f8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170851:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170864:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170871:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170876:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.170879:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170885:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170907:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141919.170909:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.170912:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170918:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a38077ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170933:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170939:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170945:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170950:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.170957:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170963:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170971:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c1400) 00010000:00010000:0.0:1783141919.170973:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.170976:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170981:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a380783e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.170997:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171003:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171008:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171013:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.171015:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171020:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171028:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.171030:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.171038:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171044:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807941 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171058:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171065:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171070:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171075:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.171077:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171083:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171090:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.171092:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.171095:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171099:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807964 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171109:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171115:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171126:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171131:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.171135:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171140:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171147:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.171150:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141919.171152:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171173:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a38079aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171186:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171191:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171197:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171203:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141919.171205:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171221:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171229:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:0.0:1783141919.171231:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141919.171234:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.171240:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807aad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141919.172868:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141919.172888:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521103104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783141919.172964:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141919.173009:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521103104 00000100:00100000:3.0:1783141919.173015:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521103104 00000100:00100000:3.0:1783141919.173067:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141919.173074:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521103104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783141919.173204:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783141919.173208:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783141919 00002000:00010000:3.0:1783141919.173210:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783141919.173211:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783141919 -> 1783141919 00002000:00010000:3.0:1783141919.173213:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783141919.173251:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521103104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (287us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783141919.173267:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1783141919.173311:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783141919.173352:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b4418aa00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1783141919.173358:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521103104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1783141919.173849:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1783141919.176779:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521103232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783141919.176848:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141919.177036:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521103232 00000100:00100000:1.0:1783141919.177044:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521103232 00000100:00100000:1.0:1783141919.177113:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141919.177123:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521103232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783141919.177148:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1783141919.177183:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a48961d, atime: 0x6a48961e, ctime: 0x6a48961d, blocks: 0x8 00010000:00010000:1.0:1783141919.177191:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.177206:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1783141919.177210:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141919.177216:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.177230:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.177241:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.177261:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.177302:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1783141919.177460:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1783141919.178522:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9c4b70c000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783141919.178529:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440ad600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c4b70c9c0 00000020:00080000:2.0:1783141919.178544:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440adb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c42af5400 00010000:00010000:2.0:1783141919.178595:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141919.178602:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.178612:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141919.178616:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.178626:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.178644:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.178651:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3807ad7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.178672:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141919.178674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141919.178675:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141919.178777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:12368:x1869759501128704:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 15757us (16598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.178787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 198 00000020:00080000:2.0:1783141919.180550:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783141919.180619:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783141919.182308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141919.182807:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521103232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5682us (5955us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783141919.182819:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141919.182846:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501128832 00000100:00100000:1.0:1783141919.182854:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501128832 00000100:00100000:1.0:1783141919.182918:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783141919.182927:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2402:x1869759501128832:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1783141919.183805:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b44209500/2, rc 0, transno 4294967308 00000100:00100000:3.0:1783141919.183814:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521103232:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1783141919.188784:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1783141919.188797:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1783141919.190491:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501128832:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 7555us (8181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.190504:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783141919.198418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141919.198968:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129088 00000100:00100000:1.0:1783141919.198984:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129088 00000100:00100000:1.0:1783141919.199037:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:1.0:1783141919.199047:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:12368:x1869759501129088:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783141919.199100:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141919.199127:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ce expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.199153:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:1.0:1783141919.199158:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141919.199187:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.199200:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.199209:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141919.199360:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003299c59a reply state 000000001df81c7e transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.199373:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.199380:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:1.0:1783141919.199382:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141919.199385:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141919.199485:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:12368:x1869759501129088:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 438us (1074us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1783141919.199493:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:3.0:1783141919.205841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.208137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129216 00000100:00100000:2.0:1783141919.208150:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129216 00000100:00100000:2.0:1783141919.208216:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:2.0:1783141919.208226:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501129216:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783141919.208397:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783141919.208402:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783141919 -> 1783141919 00002000:00010000:2.0:1783141919.208404:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783141918 00002000:00010000:2.0:1783141919.208406:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783141919 -> 1783141919 00002000:00010000:2.0:1783141919.208408:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783141919.208477:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501129216:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 252us (2645us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783141919.208485:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:1.0:1783141919.221348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.221436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129472 00000100:00100000:3.0:1783141919.221446:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129472 00000100:00100000:3.0:1783141919.221506:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:3.0:1783141919.221517:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:12368:x1869759501129472:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783141919.221595:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.221611:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.221621:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.221656:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.221671:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 20 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141919.221697:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44189f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521103360:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141919.221789:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141919.229768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.229800:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129600 00000100:00100000:2.0:1783141919.229808:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129600 00010000:00010000:2.0:1783141919.229844:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 21 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.229879:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:2.0:1783141919.229888:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:2403:x1869759501129600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141919.229915:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141919.229923:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 21 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.229944:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 21 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.229968:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:2.0:1783141919.229974:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.229983:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.229991:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.230010:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141919.230058:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:2403:x1869759501129600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.230067:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 89 00010000:00010000:1.0:1783141919.231400:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807aa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c0 expref: 20 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.231422:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44189f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521103360:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141919.231441:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231451:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231456:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231495:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231502:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231509:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231515:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141919.231520:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231527:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231539:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:1.0:1783141919.231549:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783141919.231555:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.231562:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807ae5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.231714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:12368:x1869759501129472:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 10198us (10375us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783141919.231724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:3.0:1783141919.240878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.240968:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129728 00000100:00100000:0.0:1783141919.240979:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129728 00000100:00100000:0.0:1783141919.241042:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:0.0:1783141919.241052:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501129728:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783141919.241096:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.241115:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.241123:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141919.241128:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141919.241132:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.241181:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.241195:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 8 pid: 8440 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.241209:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521103488:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141919.241313:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141919.254554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.254697:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44208a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521103488:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783141919.254724:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.254840:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501129856 00000100:00100000:1.0:1783141919.254847:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501129856 00010000:00010000:1.0:1783141919.254881:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.254928:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:1.0:1783141919.254938:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501129856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141919.254953:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141919.254978:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.254991:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.255014:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d877f25/0xb31399d6a3807ad0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8dc expref: 9 pid: 8440 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.255030:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141919.255048:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141919.255054:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.255063:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.255084:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141919.255129:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501129856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141919.255136:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 90 00010000:00010000:0.0:1783141919.255187:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255197:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255215:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255222:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255239:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255246:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783141919.255251:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255260:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255302:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.255311:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e54d56/0xb31399d6a3807aec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.255358:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501129728:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 14308us (14527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.255365:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:0.0:1783141919.258045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.258124:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501130112 00000100:00100000:2.0:1783141919.258133:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501130112 00000100:00100000:2.0:1783141919.258216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 201 00000100:00100000:2.0:1783141919.258227:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:12368:x1869759501130112:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141919.258366:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.258384:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.258394:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.258434:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.258447:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 19 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.258460:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521103616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141919.258541:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141919.266236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.266376:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521103616:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141919.266400:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501130240 00010000:00010000:2.0:1783141919.266406:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.266406:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501130240 00010000:00010000:0.0:1783141919.266439:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.266495:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 91 00000100:00100000:0.0:1783141919.266505:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:2403:x1869759501130240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141919.266521:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141919.266533:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266541:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266558:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a380793a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e865 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266570:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.266573:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266579:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266584:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.266602:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141919.266628:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.266635:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.266687:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:2403:x1869759501130240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 183us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.266694:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 91 00010000:00010000:2.0:1783141919.266791:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.266803:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.266810:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.266835:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.266852:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 19 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.266865:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521103744:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141919.266989:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141919.269171:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521103744:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141919.269197:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.270117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.270222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501130368 00000100:00100000:2.0:1783141919.270230:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501130368 00010000:00010000:2.0:1783141919.270267:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.270536:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:2.0:1783141919.270547:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:2403:x1869759501130368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141919.270563:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141919.270570:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.270583:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.270610:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807ab4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8c7 expref: 20 pid: 11334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.270658:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:2.0:1783141919.270663:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.270672:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.270678:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.270736:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141919.270799:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:2403:x1869759501130368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 253us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.270808:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00010000:00010000:2.0:1783141919.271127:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.271136:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141919.271237:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1783141919.272066:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1783141919.272112:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1783141919.272201:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869759521103872:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783141919.272260:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141919.272311:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141919.272891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521103872 00000100:00100000:1.0:1783141919.272909:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521103872 00000100:00100000:1.0:1783141919.272953:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783141919.272960:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869759521103872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783141919.273073:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869759521103872:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141919.273081:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783141919.273106:0:6522:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1783141919.273111:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b4418aa00, transno 4294967316 00000100:00100000:2.0:1783141919.273134:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869759521103872:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783141919.273629:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1783141919.273680:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869759521104000:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783141919.273716:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141919.273757:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b43411240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141919.273798:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521104000 00000100:00100000:3.0:1783141919.273803:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521104000 00000100:00100000:3.0:1783141919.273844:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783141919.273852:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1869759521104000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783141919.274031:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1869759521104000:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (313us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783141919.274038:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783141919.274584:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869759521104000:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783141919.274624:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274634:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274640:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274646:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.274650:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274658:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274674:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:2.0:1783141919.274678:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141919.274682:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807afa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274715:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274721:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274726:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274741:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.274744:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274750:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274758:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:2.0:1783141919.274760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141919.274763:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274767:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807a2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274788:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274802:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 22 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274811:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274834:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 22 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.274847:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 22 pid: 7934 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.274871:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521104128:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141919.275471:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b43411240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141919.277864:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521104128:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141919.277909:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141919.278616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141919.278673:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501130496 00000100:00100000:0.0:1783141919.278681:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501130496 00010000:00010000:0.0:1783141919.278717:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 23 pid: 7934 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141919.278756:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:0.0:1783141919.278765:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:2402:x1869759501130496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141919.278779:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141919.278785:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 23 pid: 7934 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278797:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 23 pid: 7934 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278818:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807a4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ab expref: 23 pid: 7934 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278833:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:0.0:1783141919.278838:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278845:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278852:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141919.278909:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141919.278959:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2402:x1869759501130496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141919.278967:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 93 00010000:00010000:1.0:1783141919.279424:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279433:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279453:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279460:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279475:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279491:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141919.279496:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279504:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279514:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141919.279517:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141919.279520:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279526:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807b01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279541:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279547:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279553:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279559:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141919.279561:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279587:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b427bb700) 00010000:00010000:1.0:1783141919.279589:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141919.279592:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.279596:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807af3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141919.279738:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12368:x1869759501130112:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 21512us (21700us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1783141919.279748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 201 00000020:00080000:1.0:1783141919.279751:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783141919.279780:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141919.279785:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141919.280650:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1783141919.280662:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141919.282213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.282323:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501130752 00000100:00100000:2.0:1783141919.282332:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501130752 00000100:00100000:2.0:1783141919.282386:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783141919.282394:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12368:x1869759501130752:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783141919.282630:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783141919.282659:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:2.0:1783141919.282690:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282706:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282717:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282725:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282729:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282734:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.282789:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141919.282859:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:12368:x1869759501130752:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 465us (651us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1783141919.282867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000020:00080000:2.0:1783141919.282871:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783141919.283651:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141919.283659:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.283666:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783141919.283670:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.283677:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.283866:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:3.0:1783141919.283869:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783141919.283874:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.283880:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807b08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.283983:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141919.283986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141919.283987:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141919.622518:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141919.747205:0:14658:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141919.747214:0:14658:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141919.747389:0:14658:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783141919.747396:0:14658:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141919.918179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.922745:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501131008 00000100:00100000:2.0:1783141919.922758:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501131008 00000100:00100000:2.0:1783141919.922823:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:2.0:1783141919.922834:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:12387:x1869759501131008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141919.922858:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141919.922876:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8e3 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.923006:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807b16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.923020:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807b16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.923032:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807b16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141919.923055:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783141919.923151:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8e3 expref: 26 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.923167:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807b16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8e3 expref: 25 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.923175:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141919.923178:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141919.923182:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0600, rc 0) 00000100:00100000:2.0:1783141919.923246:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:12387:x1869759501131008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 414us (5076us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783141919.923253:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:3.0:1783141919.933630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141919.933722:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501131136 00000100:00100000:2.0:1783141919.933733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501131136 00000100:00100000:2.0:1783141919.933801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 203 00000100:00100000:2.0:1783141919.933812:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:12387:x1869759501131136:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783141919.933897:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.933914:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.933925:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.933942:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.933957:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.933965:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934068:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934076:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934083:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141919.934131:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934145:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934151:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934157:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934164:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.934167:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934174:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934194:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141919.934197:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141919.934202:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934207:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807b24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934227:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934232:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934238:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934243:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.934245:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934251:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934258:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9b4218b700) 00010000:00010000:2.0:1783141919.934259:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141919.934262:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934316:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934322:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934328:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934334:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141919.934337:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934342:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141919.934353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141919.934355:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141919.934360:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807b32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141919.934435:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:12387:x1869759501131136:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 623us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141919.934445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 203 00000100:00100000:3.0:1783141919.993446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141919.993659:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501131392 00000100:00100000:1.0:1783141919.993669:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501131392 00000100:00100000:1.0:1783141919.993733:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:1.0:1783141919.993743:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+25:12390:x1869759501131392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141919.993765:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141919.993785:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8ea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993854:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993868:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993909:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993924:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993931:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.993938:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994071:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994080:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994097:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141919.994107:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783141919.994193:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994200:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994205:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994210:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141919.994220:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994227:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994239:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141919.994242:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141919.994246:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994251:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994264:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994323:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994332:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994337:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141919.994340:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994346:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994354:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c4800) 00010000:00010000:1.0:1783141919.994356:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141919.994365:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994371:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994411:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994425:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141919.994433:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141919.994435:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141919.994438:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2400, rc 0) 00000100:00100000:1.0:1783141919.994499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12390:x1869759501131392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 757us (1061us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1783141919.994507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:0.0:1783141919.997809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141919.997939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501131520 00000100:00100000:3.0:1783141919.997949:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501131520 00000100:00100000:3.0:1783141919.998022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:3.0:1783141919.998032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12390:x1869759501131520:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783141919.998111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998137:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998149:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998184:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998192:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998215:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998221:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141919.998227:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998235:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998247:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:3.0:1783141919.998250:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141919.998255:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141919.998261:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141919.998372:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12390:x1869759501131520:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 340us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141919.998380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:3.0:1783141920.007255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.008779:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501131776 00000100:00100000:0.0:1783141920.008793:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501131776 00000100:00100000:0.0:1783141920.008867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783141920.008877:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12390:x1869759501131776:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141920.009121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:12390:x1869759501131776:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 244us (1875us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1783141920.009129:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783141920.049215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.049322:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132032 00000100:00100000:3.0:1783141920.049332:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132032 00000100:00100000:3.0:1783141920.049398:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:3.0:1783141920.049408:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:11923:x1869759501132032:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141920.049444:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141920.049465:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8f1 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.049603:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.049618:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.049627:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.049666:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.049680:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 29 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.049694:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4418b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521104256:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141920.049799:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141920.051491:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4418b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521104256:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141920.051515:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141920.055886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.056062:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132160 00000100:00100000:2.0:1783141920.056072:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132160 00010000:00010000:2.0:1783141920.056111:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 30 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.056226:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:2.0:1783141920.056237:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:2403:x1869759501132160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141920.056252:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141920.056258:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 30 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056307:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 30 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056329:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a3807b4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ea expref: 30 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056344:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:2.0:1783141920.056349:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056358:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056365:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.056394:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141920.056445:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:2403:x1869759501132160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 200us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.056453:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 94 00010000:00010000:3.0:1783141920.056474:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.056484:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141920.056502:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783141920.056631:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807b63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 30 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.056648:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 29 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.056656:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:3.0:1783141920.056659:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141920.056661:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:3.0:1783141920.056708:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:11923:x1869759501132032:12345-192.168.203.39@tcp:101:bash.0 Request processed in 7301us (7502us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783141920.056715:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:0.0:1783141920.061083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.061621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132288 00000100:00100000:1.0:1783141920.061631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132288 00000100:00100000:1.0:1783141920.061692:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:1.0:1783141920.061701:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:11923:x1869759501132288:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141920.061725:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141920.061744:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8f8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.061778:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.061808:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.061819:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.062031:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f8 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.062052:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f8 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.062062:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141920.062064:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141920.062067:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3200, rc 0) 00000100:00100000:1.0:1783141920.062173:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11923:x1869759501132288:12345-192.168.203.39@tcp:101:bash.0 Request processed in 472us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141920.062189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:2.0:1783141920.069052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.069151:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132544 00000100:00100000:1.0:1783141920.069161:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132544 00000100:00100000:1.0:1783141920.069546:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 208 00000100:00100000:1.0:1783141920.069557:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:11923:x1869759501132544:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:1.0:1783141920.069768:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.069785:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.069808:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141920.069849:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:1.0:1783141920.069878:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f04d6b5 reply state 000000001c08229a transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.069901:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.069910:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141920.069912:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141920.069916:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783141920.069954:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1783141920.070051:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:11923:x1869759501132544:12345-192.168.203.39@tcp:36:bash.0 Request processed in 494us (1008us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783141920.070059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 208 00000020:00080000:1.0:1783141920.070065:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783141920.071985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.072626:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132672 00000100:00100000:2.0:1783141920.072636:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132672 00000100:00100000:2.0:1783141920.072702:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:2.0:1783141920.072711:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+34:11923:x1869759501132672:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141920.072734:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.072754:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e8ff expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.072814:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ff expref: 35 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.072829:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ff expref: 35 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.072848:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:2.0:1783141920.072851:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141920.072855:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1200, rc 0) 00000100:00100000:2.0:1783141920.072921:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:11923:x1869759501132672:12345-192.168.203.39@tcp:101:bash.0 Request processed in 211us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.072929:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:0.0:1783141920.075713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.075782:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132800 00000100:00100000:1.0:1783141920.075791:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132800 00000100:00100000:1.0:1783141920.075845:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1783141920.075855:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:11923:x1869759501132800:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141920.075872:0:8865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141920.075906:0:8865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e906 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141920.075930:0:8865:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a48961f, atime: 0x6a48961e, ctime: 0x6a48961f, blocks: 0x8 00010000:00010000:1.0:1783141920.075951:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1783141920.075962:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141920.075970:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.075988:0:8865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.076000:0:8865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2400, rc 0) 00000100:00100000:1.0:1783141920.076059:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:11923:x1869759501132800:12345-192.168.203.39@tcp:101:bash.0 Request processed in 206us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141920.076066:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:2.0:1783141920.078484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.078591:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501132928 00000100:00100000:0.0:1783141920.078601:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501132928 00002000:00010000:0.0:1783141920.078642:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1783141920.078647:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f875f80 with x1869759501132928 ext(0->18446744073709551615) 00002000:00010000:0.0:1783141920.078657:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c6f875f80. 00000100:00100000:0.0:1783141920.078739:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1783141920.078750:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501132928:12345-192.168.203.39@tcp:10:bash.0 00002000:00010000:0.0:1783141920.079025:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783141920.079029:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783141919 -> 1783141920 00002000:00010000:0.0:1783141920.079032:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783141918 -> 1783141918 00002000:00010000:0.0:1783141920.079034:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783141919 -> 1783141920 00002000:00010000:0.0:1783141920.079036:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783141920.079094:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501132928:12345-192.168.203.39@tcp:10:bash.0 Request processed in 345us (617us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1783141920.079102:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00002000:00010000:0.0:1783141920.079106:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1783141920.079109:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9c6f875f80 with x1869759501132928 ext(0->18446744073709551615) 00002000:00010000:0.0:1783141920.079114:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9c6f875f80. 00000100:00100000:0.0:1783141920.159665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.160006:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501133056 00000100:00100000:1.0:1783141920.160015:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501133056 00000100:00100000:1.0:1783141920.160073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:1.0:1783141920.160083:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:12404:x1869759501133056:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783141920.160153:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160169:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160181:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160196:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160203:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160229:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160345:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160355:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160362:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141920.160405:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160417:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160423:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160430:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160436:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.160440:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160447:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160458:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141920.160466:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.160471:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160477:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a3807b9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160491:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160497:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160502:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160506:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.160508:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160513:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160520:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c4100) 00010000:00010000:1.0:1783141920.160522:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.160525:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160530:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807ba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160545:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160557:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160562:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160567:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.160570:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160576:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160583:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141920.160585:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.160587:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.160592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807ba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141920.160678:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:12404:x1869759501133056:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 595us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141920.160687:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:3.0:1783141920.224395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.224903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501133312 00000100:00100000:1.0:1783141920.224914:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501133312 00000100:00100000:1.0:1783141920.224967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:1.0:1783141920.224978:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+35:12407:x1869759501133312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141920.225001:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141920.225035:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807bb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e90d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225105:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225120:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225130:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225143:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225150:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225155:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225254:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807bc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225265:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225306:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141920.225317:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783141920.225391:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225408:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225415:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225421:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168ea00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.225425:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225433:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225445:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141920.225448:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.225452:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225458:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807bb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225473:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225479:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225484:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225489:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.225497:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225503:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225511:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c7b5c4100) 00010000:00010000:1.0:1783141920.225514:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.225517:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225523:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225564:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807bb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e90d expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225577:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e90d expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.225584:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141920.225586:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141920.225588:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168fe00, rc 0) 00000100:00100000:1.0:1783141920.225661:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12407:x1869759501133312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 684us (1275us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783141920.225669:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:3.0:1783141920.232630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.232741:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501133440 00000100:00100000:2.0:1783141920.232750:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501133440 00000100:00100000:2.0:1783141920.232808:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:2.0:1783141920.232816:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12407:x1869759501133440:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783141920.232882:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.232919:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.232928:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.232968:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 37 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.232981:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 37 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.232995:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521104384:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141920.233106:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141920.242224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.242473:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7628e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521104384:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141920.242498:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141920.242754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501133696 00000100:00100000:0.0:1783141920.242762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501133696 00000100:00100000:0.0:1783141920.242821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783141920.242831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:6168:x1869759501133696:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783141920.243105:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:6168:x1869759501133696:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 275us (890us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1783141920.243114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:3.0:1783141920.246096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.246365:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501133824 00000100:00100000:0.0:1783141920.246374:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501133824 00010000:00010000:0.0:1783141920.246411:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 39 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141920.246448:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:0.0:1783141920.246457:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:2402:x1869759501133824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141920.246482:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141920.246488:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 39 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246501:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 39 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807b6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f1 expref: 39 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246536:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:0.0:1783141920.246541:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246550:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246558:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.246589:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141920.246642:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:2402:x1869759501133824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141920.246648:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00010000:00010000:2.0:1783141920.246931:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.246954:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.246991:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.246999:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.247018:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.247025:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.247028:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.247036:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.247047:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:2.0:1783141920.247050:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141920.247054:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.247060:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.247124:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12407:x1869759501133440:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 14301us (14497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.247132:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:3.0:1783141920.249350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.249473:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501134080 00000100:00100000:0.0:1783141920.249482:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501134080 00000100:00100000:0.0:1783141920.249531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783141920.249540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+37:12407:x1869759501134080:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783141920.249841:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:12407:x1869759501134080:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 301us (504us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783141920.249853:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783141920.317021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.317466:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501134336 00000100:00100000:2.0:1783141920.317476:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501134336 00000100:00100000:2.0:1783141920.317589:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 213 00000100:00100000:2.0:1783141920.317599:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+38:12418:x1869759501134336:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1783141920.317623:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.317643:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e914 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317732:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317747:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317758:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317770:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317777:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317784:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317948:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807bef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317957:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.317964:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141920.317973:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783141920.318036:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318052:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318058:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318063:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.318067:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318074:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318085:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141920.318087:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141920.318092:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318098:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807be1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318112:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318118:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318123:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318128:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.318137:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318143:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318150:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.318153:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141920.318155:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318161:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807be8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318206:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807bda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e914 expref: 41 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318217:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e914 expref: 40 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.318224:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:2.0:1783141920.318226:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141920.318228:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0000, rc 0) 00000100:00100000:2.0:1783141920.319066:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12418:x1869759501134336:12345-192.168.203.39@tcp:101:cat.0 Request processed in 1463us (2048us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783141920.319075:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 213 00000040:00080000:3.0:1783141920.324457:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141920.324465:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141920.324564:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783141920.324572:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141920.329437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.329550:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501134592 00000100:00100000:3.0:1783141920.329559:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501134592 00000100:00100000:3.0:1783141920.329666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783141920.329676:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+40:12418:x1869759501134592:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:3.0:1783141920.330018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:12418:x1869759501134592:12345-192.168.203.39@tcp:35:cat.0 Request processed in 342us (588us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1783141920.330043:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783141920.350515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.350604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501134848 00000100:00100000:0.0:1783141920.350614:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501134848 00000100:00100000:0.0:1783141920.350673:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 214 00000100:00100000:0.0:1783141920.350682:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+41:12419:x1869759501134848:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:0.0:1783141920.350737:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1783141920.350762:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807b8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8ff expref: 41 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350791:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0000/0xb31399d6a3807bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e914 expref: 40 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350804:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807bc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e90d expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350817:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a3807b7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8f8 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350828:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:0.0:1783141920.350833:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141920.350853:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350866:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350900:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350917:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350924:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.350931:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351007:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351016:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351023:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141920.351213:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1783141920.351224:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431417950830ns, next at 432417948544ns, rc = 0 00010000:00010000:0.0:1783141920.351267:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351323:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351331:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351349:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351354:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351360:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351371:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141920.351394:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351400:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351406:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351411:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141920.351415:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351421:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351429:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:0.0:1783141920.351431:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783141920.351434:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351449:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c0b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351464:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351469:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351474:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351478:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141920.351480:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351485:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351492:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141920.351494:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141920.351497:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351502:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807bfd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141920.351509:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d5a89e8 reply state 00000000ab1f7c53 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351519:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.351530:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:0.0:1783141920.351532:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141920.351535:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141920.351607:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:12419:x1869759501134848:12345-192.168.203.39@tcp:36:rm.0 Request processed in 925us (1100us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783141920.351616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 214 00010000:00010000:2.0:1783141920.351694:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141920.351700:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.351715:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141920.351718:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.351724:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.351733:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:2.0:1783141920.351735:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783141920.351738:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.351744:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807c12 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.351754:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141920.351756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141920.351757:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141920.390155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.392677:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135104 00000100:00100000:0.0:1783141920.392691:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135104 00000100:00100000:0.0:1783141920.392766:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:0.0:1783141920.392777:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+39:12425:x1869759501135104:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783141920.392800:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141920.392820:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807c19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e91b expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.392934:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.392950:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.392961:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.392972:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.392978:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.393003:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141920.393541:0:7934:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783141920.393673:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.393683:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.393692:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395568:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395601:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395609:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395616:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141920.395621:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395627:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395641:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141920.395644:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141920.395648:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395654:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fe00/0xb31399d6a3807c20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141920.395669:0:7934:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dba9372c reply state 000000003f26a0a9 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395681:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395687:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:1.0:1783141920.395689:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783141920.395692:0:7934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783141920.395734:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807c19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 42 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395756:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 41 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.395762:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:1.0:1783141920.395764:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141920.395766:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:1.0:1783141920.395855:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7628e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:12425:x1869759501135104:12345-192.168.203.39@tcp:101:bash.0 Request processed in 3079us (5710us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783141920.395863:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:3.0:1783141920.399004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.399104:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135232 00000100:00100000:2.0:1783141920.399113:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135232 00000100:00100000:2.0:1783141920.399224:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783141920.399234:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501135232:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141920.399260:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.399302:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e922 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141920.399327:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783141920.399357:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1783141920.399374:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141920.399383:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.399401:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.399415:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1800, rc 0) 00000100:00100000:2.0:1783141920.399465:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501135232:12345-192.168.203.39@tcp:101:bash.0 Request processed in 233us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.399471:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00080000:0.0:1783141920.400993:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141920.403103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.403164:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135360 00000100:00100000:1.0:1783141920.403175:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135360 00000100:00100000:1.0:1783141920.403232:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:1.0:1783141920.403249:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:12425:x1869759501135360:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783141920.403266:0:8865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141920.403310:0:8865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e929 expref: -99 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.403349:0:8865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.403358:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141920.403361:0:8865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141920.403366:0:8865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 9 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.403418:0:8865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.403430:0:8865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141920.403443:0:8865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8865:1869759521104512:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141920.403531:0:8865:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b82b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141920.409180:0:8865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8865:1869759521104512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141920.409219:0:8865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 9 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.409249:0:8865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168ea00, rc 0) 00000100:00100000:1.0:1783141920.409334:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:12425:x1869759501135360:12345-192.168.203.39@tcp:101:bash.0 Request processed in 6093us (6238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141920.409351:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:3.0:1783141920.410076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.410444:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135488 00000100:00100000:2.0:1783141920.410451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135488 00010000:00010000:2.0:1783141920.410485:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.410522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:2.0:1783141920.410531:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501135488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141920.410544:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141920.410565:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.410578:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.410601:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e922 expref: 9 pid: 8438 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.410636:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141920.410640:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141920.410648:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.410659:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.410964:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.410979:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6507:1869759521104640:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783141920.411122:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141920.420739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.420838:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135744 00000100:00100000:1.0:1783141920.420846:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135744 00000100:00100000:1.0:1783141920.420908:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1783141920.420918:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+42:12425:x1869759501135744:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783141920.420972:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6507:1869759521104640:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783141920.420994:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141920.421050:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501135488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10518us (10973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141920.421060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:1.0:1783141920.421198:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12425:x1869759501135744:12345-192.168.203.39@tcp:35:bash.0 Request processed in 281us (469us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1783141920.421206:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000040:00080000:2.0:1783141920.453019:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783141920.555265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.555349:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501135872 00000100:00100000:2.0:1783141920.555360:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501135872 00000100:00100000:2.0:1783141920.555415:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 216 00000100:00100000:2.0:1783141920.555424:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+43:12441:x1869759501135872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141920.555449:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.555473:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e930 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555539:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555570:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555583:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141920.555639:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783141920.555642:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141920.555662:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555694:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e930 expref: 45 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555721:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e930 expref: 44 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.555730:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141920.555733:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141920.555737:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783141920.555808:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:12441:x1869759501135872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 384us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.555816:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 216 00000100:00100000:0.0:1783141920.561701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.562302:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136128 00000100:00100000:1.0:1783141920.562312:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136128 00000100:00100000:1.0:1783141920.562374:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:1.0:1783141920.562383:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+44:12441:x1869759501136128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141920.562402:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141920.562423:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ee00/0xb31399d6a3807c58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e937 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.562525:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.562540:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.562551:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141920.562562:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783141920.562673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ee00/0xb31399d6a3807c58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e937 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.562694:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e937 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.562702:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:1.0:1783141920.562704:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141920.562708:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e400, rc 0) 00000100:00100000:1.0:1783141920.562774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+46:12441:x1869759501136128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 391us (1088us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1783141920.562797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:0.0:1783141920.565058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141920.567522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.567588:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136512 00000100:00100000:3.0:1783141920.567599:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136512 00000100:00100000:3.0:1783141920.567663:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 218 00000100:00100000:3.0:1783141920.567673:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+46:12441:x1869759501136512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141920.567709:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141920.567730:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807c6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e93e expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.567833:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.567848:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.567859:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141920.567873:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783141920.567980:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807c6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e93e expref: 49 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.568020:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e93e expref: 48 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.568029:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:3.0:1783141920.568032:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783141920.568035:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:3.0:1783141920.568102:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:12441:x1869759501136512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 430us (588us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1783141920.568112:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 218 00000100:00100000:1.0:1783141920.568119:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136256 00000100:00100000:1.0:1783141920.568125:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136256 00000100:00100000:1.0:1783141920.568174:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783141920.568181:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+48:2403:x1869759501136256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141920.568191:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141920.568216:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e937 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.568229:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:1.0:1783141920.568232:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141920.568262:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:2403:x1869759501136256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 83us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141920.568268:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783141920.579248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.579470:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136640 00000100:00100000:2.0:1783141920.579479:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136640 00000100:00100000:2.0:1783141920.579532:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:2.0:1783141920.579542:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501136640:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1783141920.579590:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.579622:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.579630:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141920.579634:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141920.579638:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.579670:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.579684:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 8 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.579698:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521104768:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141920.579799:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141920.586861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.586962:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136768 00000100:00100000:3.0:1783141920.586973:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136768 00000100:00100000:2.0:1783141920.587012:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1869759521104768:192.168.203.39@tcp:104: 00002000:00100000:3.0:1783141920.587022:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f9b44208e00 x1869759501136768/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:296/0 lens 504/0 e 0 to 0 dl 1783141931 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141920.587034:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b44208e00 with x1869759501136768 ext(0->8) 00010000:00010000:2.0:1783141920.587039:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.587042:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 9 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.587071:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 9 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141920.587079:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9b44208e00 00000100:00100000:3.0:1783141920.587114:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783141920.587124:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501136768:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:3.0:1783141920.588268:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2402:x1869759501136768:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 1142us (1413us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783141920.588400:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00002000:00100000:3.0:1783141920.588410:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f9b44208e00 x1869759501136768/t4294967309(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:296/0 lens 504/448 e 0 to 0 dl 1783141931 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141920.588420:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b44208e00 with x1869759501136768 ext(0->8) 00010000:00010000:3.0:1783141920.588429:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.588444:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141920.588452:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f9b44208e00 00000100:00100000:0.0:1783141920.593712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.593899:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501136896 00000100:00100000:3.0:1783141920.593910:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501136896 00010000:00010000:3.0:1783141920.593948:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.594044:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:3.0:1783141920.594054:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2400:x1869759501136896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141920.594069:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783141920.594085:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783141920.594088:0:10341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783141920 00002000:00010000:3.0:1783141920.594091:0:10341:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783141921 00002000:00010000:3.0:1783141920.594092:0:10341:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783141920 00002000:00010000:3.0:1783141920.594095:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783141920.594101:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.594127:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.594149:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21961df/0xb31399d6a3807c43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e929 expref: 11 pid: 8865 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.594166:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141920.594170:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141920.594175:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.594184:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.594219:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141920.594296:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594308:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594337:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.594339:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2400:x1869759501136896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 276us (627us total) trans 0 rc 0/0 00010000:00010000:2.0:1783141920.594355:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.594358:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 97 00010000:00010000:2.0:1783141920.594368:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594375:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141920.594380:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594389:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594401:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.594409:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3807c82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.594468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501136640:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 14927us (15241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.594476:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783141920.597858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141920.598033:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501137152 00000100:00100000:1.0:1783141920.598043:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501137152 00000100:00100000:1.0:1783141920.598099:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:1.0:1783141920.598109:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+47:12441:x1869759501137152:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:1.0:1783141920.598170:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e93e expref: 47 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141920.598568:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1783141920.598605:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1783141920.598876:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1783141920.598926:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.598959:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 51 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.598969:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.599001:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 51 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.599016:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 51 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141920.599029:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521104896:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141920.599115:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b82b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141920.604758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.605008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501137280 00000100:00100000:2.0:1783141920.605018:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501137280 00010000:00010000:2.0:1783141920.605056:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 52 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.605096:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:2.0:1783141920.605106:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:2403:x1869759501137280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141920.605121:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141920.605128:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 52 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.605141:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 52 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.605171:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:2.0:1783141920.605178:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.605188:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.605196:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.605214:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141920.605269:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+52:2403:x1869759501137280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 163us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.605297:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00010000:00010000:1.0:1783141920.605475:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807c2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e91b expref: 51 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141920.605492:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869759521104896:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141920.605517:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.605527:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141920.605533:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141920.605630:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1783141920.605759:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1783141920.605837:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521105024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783141920.605878:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141920.605993:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141920.606459:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521105024 00000100:00100000:3.0:1783141920.606465:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521105024 00000100:00100000:3.0:1783141920.606611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783141920.606620:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521105024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783141920.606759:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521105024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141920.606767:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783141920.607030:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521105024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141920.607153:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:0.0:1783141920.607252:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521105152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783141920.607397:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141920.607457:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c467769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141920.607494:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521105152 00000100:00100000:2.0:1783141920.607514:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521105152 00000100:00100000:2.0:1783141920.607632:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783141920.607641:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1869759521105152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141920.607749:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6526:x1869759521105152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (352us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783141920.607756:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783141920.607814:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44188e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869759521105152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141920.607851:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1783141920.607882:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607902:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607910:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607915:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141920.607919:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607926:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607940:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:0.0:1783141920.607943:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783141920.607948:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141920.607954:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807c89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141920.608040:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783141920.608104:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1783141920.608115:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431674843059ns, next at 432674840842ns, rc = 0 00000001:00080000:0.0:1783141920.608121:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:0.0:1783141920.608142:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:0.0:1783141920.608145:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141920.608151:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807c74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e93e expref: 55 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141920.608254:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:12441:x1869759501137152:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 10146us (10404us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783141920.608262:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000020:00080000:0.0:1783141920.608266:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783141920.610237:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.610500:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501137408 00000100:00100000:2.0:1783141920.610508:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501137408 00000100:00100000:2.0:1783141920.610635:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:2.0:1783141920.610646:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+54:12441:x1869759501137408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141920.610668:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.610687:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e945 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.610741:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e945 expref: 55 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.610755:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e945 expref: 55 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.610772:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.610775:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141920.610778:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1800, rc 0) 00000100:00100000:2.0:1783141920.610834:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:12441:x1869759501137408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 190us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.610841:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:1.0:1783141920.615391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.615585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501137664 00000100:00100000:3.0:1783141920.615595:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501137664 00000100:00100000:3.0:1783141920.615644:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:3.0:1783141920.615654:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+55:12441:x1869759501137664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783141920.615910:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:12441:x1869759501137664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 257us (530us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783141920.615919:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00010000:00010000:3.0:1783141920.644620:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141920.700128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.700236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501137792 00000100:00100000:2.0:1783141920.700260:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501137792 00000100:00100000:2.0:1783141920.700376:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:2.0:1783141920.700387:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:12451:x1869759501137792:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783141920.700472:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700490:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700502:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700513:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700521:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700527:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700598:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700605:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700611:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141920.700663:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700687:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700693:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700699:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700704:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.700708:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700716:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700730:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141920.700733:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141920.700738:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700744:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807c97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700765:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700772:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700778:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700789:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.700792:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700798:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700807:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:2.0:1783141920.700810:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141920.700813:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700819:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807c9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700830:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700836:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700841:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700846:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.700849:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700855:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700873:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.700876:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141920.700879:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.700895:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.700979:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:12451:x1869759501137792:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 593us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.700988:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:1.0:1783141920.750037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.750197:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138048 00000100:00100000:3.0:1783141920.750206:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138048 00000100:00100000:3.0:1783141920.751016:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:3.0:1783141920.751034:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+56:12454:x1869759501138048:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141920.751054:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141920.751158:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807cac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e94c expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751231:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751252:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751263:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751523:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751537:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751557:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751728:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751737:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.751744:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141920.752317:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783141920.752542:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752551:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752558:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752564:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141920.752568:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752575:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752589:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141920.752592:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141920.752605:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752612:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807cb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752629:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752635:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752640:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752645:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141920.752648:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752654:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752662:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:3.0:1783141920.752664:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141920.752667:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752673:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752716:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807cac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 59 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.752743:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 58 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.756464:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141920.756469:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141920.756473:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3c00, rc 0) 00000100:00100000:3.0:1783141920.756562:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12454:x1869759501138048:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5530us (6529us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1783141920.756571:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:1.0:1783141920.767299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.768458:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138176 00000100:00100000:2.0:1783141920.768470:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138176 00000100:00100000:2.0:1783141920.768539:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 222 00000100:00100000:2.0:1783141920.768550:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12454:x1869759501138176:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783141920.768616:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768634:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768646:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768680:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768687:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768714:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768720:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141920.768724:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768732:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768743:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.768746:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141920.768765:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.768772:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807ccf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.768856:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12454:x1869759501138176:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 308us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.768866:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 222 00000100:00100000:1.0:1783141920.774852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.775475:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138432 00000100:00100000:3.0:1783141920.775486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138432 00000100:00100000:3.0:1783141920.775543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:3.0:1783141920.775553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+58:12454:x1869759501138432:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783141920.775823:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12454:x1869759501138432:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 270us (978us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1783141920.775831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:1.0:1783141920.873985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.874103:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138688 00000100:00100000:2.0:1783141920.874113:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138688 00000100:00100000:2.0:1783141920.874175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:2.0:1783141920.874184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12464:x1869759501138688:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141920.874209:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.874212:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141920.874238:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807c51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e930 expref: 59 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874317:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:2.0:1783141920.874322:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141920.874356:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807cd6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e953 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874460:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874475:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 59 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874483:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874528:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 59 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.874549:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 59 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.874564:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105280:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141920.874667:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141920.878135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.878225:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105280:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141920.878248:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.878374:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138816 00000100:00100000:3.0:1783141920.878380:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138816 00010000:00010000:3.0:1783141920.878415:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 60 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.878448:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:3.0:1783141920.878455:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:2403:x1869759501138816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141920.878468:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141920.878486:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 60 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878497:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 60 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878784:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807cc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e94c expref: 60 pid: 7934 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878802:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141920.878806:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878815:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878821:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.878872:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141920.878936:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:2403:x1869759501138816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 480us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141920.878943:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 99 00010000:00010000:2.0:1783141920.885174:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.885208:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141920.885242:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783141920.885453:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807cd6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.885477:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.885487:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.885490:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141920.885493:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783141920.885710:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12464:x1869759501138688:12345-192.168.203.39@tcp:101:bash.0 Request processed in 11525us (11732us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1783141920.885719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:1.0:1783141920.890567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.890829:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501138944 00000100:00100000:3.0:1783141920.890838:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501138944 00000100:00100000:3.0:1783141920.890909:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 224 00000100:00100000:3.0:1783141920.890919:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+59:12464:x1869759501138944:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783141920.890943:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141920.890964:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807ceb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e95a expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891007:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891021:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891031:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891141:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807ceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 61 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891160:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 60 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.891168:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141920.891171:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783141920.891174:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2800, rc 0) 00000100:00100000:3.0:1783141920.891231:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:12464:x1869759501138944:12345-192.168.203.39@tcp:101:bash.0 Request processed in 313us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141920.891239:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 224 00000100:00100000:3.0:1783141920.895765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.895954:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139200 00000100:00100000:2.0:1783141920.895965:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139200 00000100:00100000:2.0:1783141920.896022:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00100000:2.0:1783141920.896032:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+60:12464:x1869759501139200:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:3.0:1783141920.897434:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.897458:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.897470:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141920.897767:0:11334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1783141920.897813:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb90ef65 reply state 000000004e5e7276 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.897828:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.897835:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141920.897838:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783141920.897841:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141920.897967:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12464:x1869759501139200:12345-192.168.203.39@tcp:36:bash.0 Request processed in 1933us (2207us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1783141920.897976:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 225 00000020:00080000:3.0:1783141920.897981:0:11334:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783141920.904815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141920.904918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139328 00000100:00100000:2.0:1783141920.904928:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139328 00000100:00100000:2.0:1783141920.904984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 226 00000100:00100000:2.0:1783141920.904994:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12464:x1869759501139328:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783141920.905016:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141920.905036:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e961 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.905152:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.905167:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.905178:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.905211:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.905225:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 64 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.905239:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105408:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141920.905506:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141920.910844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.910924:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139456 00000100:00100000:3.0:1783141920.910932:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139456 00010000:00010000:3.0:1783141920.910971:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 65 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141920.911064:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:3.0:1783141920.911074:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:2402:x1869759501139456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141920.911088:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141920.911094:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 65 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.911109:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 65 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.911150:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141920.911155:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.911164:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.911172:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141920.911189:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141920.911257:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:2402:x1869759501139456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 184us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141920.911265:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00010000:00010000:2.0:1783141920.914971:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807cdd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e953 expref: 64 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141920.915004:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105408:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141920.915039:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.915049:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.915076:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141920.915132:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783141920.915136:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141920.915158:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.915187:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.915201:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141920.915209:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141920.915212:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141920.915216:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1a00, rc 0) 00000100:00100000:2.0:1783141920.915316:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12464:x1869759501139328:12345-192.168.203.39@tcp:101:bash.0 Request processed in 10322us (10509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141920.915326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 226 00000100:00100000:1.0:1783141920.924489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141920.924876:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139712 00000100:00100000:3.0:1783141920.924895:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139712 00000100:00100000:3.0:1783141920.924960:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:3.0:1783141920.924971:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+63:12464:x1869759501139712:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:3.0:1783141920.925190:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12464:x1869759501139712:12345-192.168.203.39@tcp:35:bash.0 Request processed in 220us (710us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1783141920.925198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:0.0:1783141921.003175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.003269:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139840 00000100:00100000:3.0:1783141921.003318:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139840 00000100:00100000:3.0:1783141921.003410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 227 00000100:00100000:3.0:1783141921.003421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+64:12470:x1869759501139840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141921.003447:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141921.003487:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e968 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003559:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003573:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003586:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141921.003629:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783141921.003633:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141921.003651:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e968 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003698:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e968 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.003706:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141921.003709:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141921.003712:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3c00, rc 0) 00000100:00100000:3.0:1783141921.003764:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501139840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 345us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.003771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 227 00000100:00080000:0.0:1783141921.004137:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141921.010978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.011070:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501139968 00000100:00100000:3.0:1783141921.011096:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501139968 00000100:00100000:3.0:1783141921.011157:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 228 00000100:00100000:3.0:1783141921.011168:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501139968:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783141921.011190:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141921.011210:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e96f expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011657:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011674:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011687:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011699:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011707:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011714:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011785:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011794:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.011801:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141921.011848:0:11334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783141921.011853:0:11334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783141921.011870:0:11334:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012119:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012130:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012137:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012143:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012149:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141921.012153:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012160:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012172:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141921.012175:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141921.012179:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012185:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807d23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012210:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012217:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012223:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012228:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141921.012484:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012493:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012502:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:3.0:1783141921.012515:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141921.012518:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012524:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012558:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e96f expref: 67 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012572:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e96f expref: 66 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.012592:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141921.012594:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141921.012597:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2c00, rc 0) 00000100:00100000:3.0:1783141921.012666:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12470:x1869759501139968:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1500us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.012675:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 228 00000100:00100000:1.0:1783141921.017560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141921.019460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.019542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140352 00000100:00100000:0.0:1783141921.019552:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140352 00000100:00100000:0.0:1783141921.019627:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783141921.019637:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:2400:x1869759501140352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783141921.019639:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140224 00000100:00100000:2.0:1783141921.019643:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140224 00010000:00010000:0.0:1783141921.019653:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.019677:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2c00/0xb31399d6a3807d31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e96f expref: 67 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.019679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:2.0:1783141921.019686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12470:x1869759501140224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141921.019697:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:0.0:1783141921.019702:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141921.019703:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141921.019715:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e976 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.019751:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:2400:x1869759501140352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.019758:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00010000:00010000:2.0:1783141921.020214:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.020239:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.020248:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.020587:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.020601:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 66 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.020613:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105536:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141921.020689:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141921.024689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.024766:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140480 00000100:00100000:3.0:1783141921.024775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140480 00010000:00010000:3.0:1783141921.024818:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 67 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.024861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:3.0:1783141921.024870:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:2403:x1869759501140480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141921.024895:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141921.024902:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 67 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.024915:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 67 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.024938:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141921.024943:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.024954:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.024979:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.024998:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141921.025054:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:2403:x1869759501140480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.025061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 101 00010000:00010000:2.0:1783141921.025069:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807d07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e961 expref: 67 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.025095:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521105536:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141921.025114:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.025123:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.025141:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141921.025159:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783141921.025301:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.025317:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.025325:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141921.025328:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141921.025330:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783141921.025357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12470:x1869759501140224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5672us (7806us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783141921.025364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:2.0:1783141921.028666:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521105664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141921.028743:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141921.029808:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521105664 00000100:00100000:1.0:1783141921.029819:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521105664 00000100:00100000:1.0:1783141921.029985:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783141921.029995:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521105664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783141921.030031:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783141921.030116:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521105664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.030124:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783141921.030396:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521105664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141921.031905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.031940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.031974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.032002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.032005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140736 00000100:00100000:2.0:1783141921.032013:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140736 00000100:00100000:0.0:1783141921.032021:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140864 00000100:00100000:0.0:1783141921.032024:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140864 00000100:00100000:2.0:1783141921.032059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140992 00000100:00100000:2.0:1783141921.032062:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140992 00000100:00100000:0.0:1783141921.032063:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:0.0:1783141921.032071:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501140864:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141921.032080:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 294 00000100:00100000:2.0:1783141921.032087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501140736:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141921.032130:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501140736:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.032147:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:2.0:1783141921.032152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 294 00000100:00100000:3.0:1783141921.032155:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501140992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1783141921.032208:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141921.032213:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141921.032215:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783141921.032535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501140608 00000100:00100000:1.0:1783141921.032540:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501140608 00000100:00100000:0.0:1783141921.033314:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2402:x1869759501140864:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1237us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.033324:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:0.0:1783141921.033546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.033612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141120 00000100:00100000:0.0:1783141921.033617:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141120 00000100:00100000:0.0:1783141921.033652:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 296 00000100:00100000:0.0:1783141921.033659:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501141120:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141921.033703:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501141120:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.033710:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 296 00000100:00100000:1.0:1783141921.034083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 382 00000100:00100000:1.0:1783141921.034094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501140608:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141921.034126:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501140608:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.034133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 382 00000100:00080000:3.0:1783141921.036123:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141921.036170:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501140992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4009us (4223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.036182:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:0.0:1783141921.037703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.037776:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141376 00000100:00100000:3.0:1783141921.037785:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141376 00000100:00100000:3.0:1783141921.037841:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783141921.037851:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12470:x1869759501141376:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:3.0:1783141921.037866:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141921.037900:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807c90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e945 expref: 66 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.037922:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141921.037927:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141921.037981:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501141376:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.037989:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:0.0:1783141921.040666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.040728:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141504 00000100:00100000:2.0:1783141921.040737:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141504 00000100:00100000:2.0:1783141921.040795:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 230 00000100:00100000:2.0:1783141921.040805:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501141504:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:2.0:1783141921.040926:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.040943:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.040955:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141921.041064:0:11334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783141921.041144:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501141504:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 340us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.041152:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 230 00000100:00100000:1.0:1783141921.043453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.043503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141632 00000100:00100000:0.0:1783141921.043512:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141632 00000100:00100000:0.0:1783141921.043575:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 231 00000100:00100000:0.0:1783141921.043585:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+65:12470:x1869759501141632:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783141921.043608:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141921.043640:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e97d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043690:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043702:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043720:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043733:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043747:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:0.0:1783141921.043750:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141921.043754:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.043761:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e400, rc 0) 00000100:00100000:0.0:1783141921.043818:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12470:x1869759501141632:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 234us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.043824:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 231 00000040:00080000:3.0:1783141921.349217:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141921.349226:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141921.349249:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783141921.349260:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141921.349411:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521105792:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141921.349541:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141921.355981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.356136:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141760 00000100:00100000:0.0:1783141921.356146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141760 00000100:00100000:0.0:1783141921.356216:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:0.0:1783141921.356226:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501141760:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783141921.356305:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783141921.356439:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501141760:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 214us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.356456:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:3.0:1783141921.356809:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521105792:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141921.361575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141921.361693:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501141888 00000100:00100000:1.0:1783141921.361703:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501141888 00000100:00100000:1.0:1783141921.361765:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00100000:1.0:1783141921.361775:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12471:x1869759501141888:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783141921.361851:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361868:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361888:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361903:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361910:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361917:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361938:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361973:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.361980:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141921.362029:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783141921.362034:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141921.362048:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362058:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362065:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362072:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362078:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.362083:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362090:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362100:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:1.0:1783141921.362103:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.362108:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362125:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807d5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362139:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362145:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362155:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362162:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fa00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.362167:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362173:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362180:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9f9c7b5c4100) 00010000:00010000:1.0:1783141921.362182:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.362185:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362190:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807d62 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362203:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362208:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362218:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362223:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fe00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.362225:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362238:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362245:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141921.362247:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.362249:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.362254:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fe00/0xb31399d6a3807d69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.362601:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12471:x1869759501141888:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 825us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.362610:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00100000:1.0:1783141921.365870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.366071:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501142144 00000100:00100000:3.0:1783141921.366080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501142144 00000100:00100000:3.0:1783141921.366128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00100000:3.0:1783141921.366135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+66:12471:x1869759501142144:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141921.366153:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141921.366173:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e984 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366314:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366338:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366350:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141921.366363:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783141921.366436:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366444:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366463:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366470:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141921.366473:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366482:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366493:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141921.366496:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783141921.366500:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366506:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2200/0xb31399d6a3807d77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366548:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d70 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e984 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366558:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:3.0:1783141921.366560:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141921.366564:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807d70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e984 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.366573:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc3800, rc 0) 00000100:00100000:3.0:1783141921.366632:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142144:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 497us (770us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1783141921.366648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00100000:3.0:1783141921.374702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.377948:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501142272 00000100:00100000:0.0:1783141921.377963:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501142272 00000100:00100000:0.0:1783141921.378036:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:0.0:1783141921.378046:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142272:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783141921.378083:0:11334:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783141921.378200:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142272:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 155us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.378209:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:1.0:1783141921.384109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.384552:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501142528 00000100:00100000:0.0:1783141921.384562:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501142528 00000100:00100000:0.0:1783141921.384622:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:0.0:1783141921.384632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142528:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.384652:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141921.384654:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141921.384680:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3c00/0xb31399d6a3807d15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e968 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.384700:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141921.384705:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141921.384717:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807d85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e98b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141921.385073:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1783141921.385224:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807d8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.385252:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.385262:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.385361:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807d85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e98b expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.385376:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e98b expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.385383:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:0.0:1783141921.385386:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141921.385388:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407ea00, rc 0) 00000100:00100000:0.0:1783141921.385453:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12471:x1869759501142528:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 822us (1352us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1783141921.385461:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:1.0:1783141921.391811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.392121:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501142784 00000100:00100000:0.0:1783141921.392130:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501142784 00000100:00100000:0.0:1783141921.392186:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:0.0:1783141921.392196:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12471:x1869759501142784:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.392266:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.392325:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ea00/0xb31399d6a3807d8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e98b expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392625:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8100) 00010000:00010000:0.0:1783141921.392635:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141921.392655:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392667:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392676:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392736:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392744:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392749:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392792:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392799:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392805:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392810:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141921.392814:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392828:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392837:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:0.0:1783141921.392840:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141921.392844:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392850:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f800/0xb31399d6a3807d9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392859:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392865:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392870:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.392875:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783141921.395098:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.395123:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.395141:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x16a0cfe2 (ffff9f9c49ac8900) 00010000:00010000:0.0:1783141921.395145:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141921.395150:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.395189:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807da1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x16a0cfe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.395567:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142784:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 3368us (3761us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141921.395577:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:1.0:1783141921.399307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.399506:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501142912 00000100:00100000:0.0:1783141921.399515:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501142912 00000100:00100000:0.0:1783141921.399573:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:0.0:1783141921.399583:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+67:12471:x1869759501142912:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.399602:0:11334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141921.399623:0:11334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807da8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e992 expref: -99 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399655:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399667:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399678:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399789:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e800/0xb31399d6a3807da8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 69 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399807:0:11334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 68 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.399828:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:0.0:1783141921.399830:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141921.399834:0:11334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:0.0:1783141921.399901:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12471:x1869759501142912:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 319us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.399922:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:1.0:1783141921.402929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.403045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501143168 00000100:00100000:3.0:1783141921.403055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501143168 00000100:00100000:3.0:1783141921.403110:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:3.0:1783141921.403120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+68:12471:x1869759501143168:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783141921.403223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.403237:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.403246:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141921.403435:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1783141921.403446:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432470173578ns, next at 433470170962ns, rc = 0 00000004:00010000:3.0:1783141921.403497:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000634e6933 reply state 00000000dda700db transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.403509:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.403518:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:3.0:1783141921.403521:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783141921.403524:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141921.403623:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12471:x1869759501143168:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 504us (703us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1783141921.403631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:1.0:1783141921.405761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.406484:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501143296 00000100:00100000:0.0:1783141921.406495:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501143296 00000100:00100000:0.0:1783141921.406556:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:0.0:1783141921.406566:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+70:12471:x1869759501143296:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.406587:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141921.406605:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e999 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.406659:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.406672:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.406692:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:0.0:1783141921.406696:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141921.406699:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141921.406854:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12471:x1869759501143296:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 288us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.406889:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:0.0:1783141921.411411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.411533:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501143424 00000100:00100000:3.0:1783141921.411543:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501143424 00000100:00100000:3.0:1783141921.411655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783141921.411667:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2401:x1869759501143424:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783141921.411872:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2401:x1869759501143424:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 207us (469us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1783141921.411890:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:1.0:1783141921.413917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.413991:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501143680 00000100:00100000:3.0:1783141921.414000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501143680 00000100:00100000:3.0:1783141921.414052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1783141921.414061:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+71:12471:x1869759501143680:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783141921.414302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+72:12471:x1869759501143680:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 241us (390us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1783141921.414310:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1783141921.416921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.417180:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501143936 00000100:00100000:2.0:1783141921.417189:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501143936 00000100:00100000:2.0:1783141921.417253:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00100000:2.0:1783141921.417263:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+72:12471:x1869759501143936:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141921.417605:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+72:12471:x1869759501143936:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 343us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.417614:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00100000:1.0:1783141921.419672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.419844:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144064 00000100:00100000:2.0:1783141921.419852:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144064 00000100:00100000:2.0:1783141921.419927:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:2.0:1783141921.419937:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+72:12471:x1869759501144064:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141921.419957:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141921.419976:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807dc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9a0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420040:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420054:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420065:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141921.420107:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783141921.420125:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420150:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1a00/0xb31399d6a3807dc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a0 expref: 74 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420174:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a0 expref: 73 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.420183:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:2.0:1783141921.420186:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783141921.420190:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1800, rc 0) 00000100:00100000:2.0:1783141921.420460:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+73:12471:x1869759501144064:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 524us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.420468:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:1.0:1783141921.423055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.423147:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144192 00000100:00100000:0.0:1783141921.423158:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144192 00000100:00100000:0.0:1783141921.423217:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:0.0:1783141921.423227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+10:2402:x1869759501144192:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.423257:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141921.423315:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9a7 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141921.423350:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a489621, blocks: 0x0 00010000:00010000:0.0:1783141921.423368:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1783141921.423373:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141921.423381:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.423401:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.423414:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e800, rc 0) 00000100:00100000:0.0:1783141921.423469:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:2402:x1869759501144192:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 243us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.423477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:1.0:1783141921.426385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.426523:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144448 00000100:00100000:0.0:1783141921.426533:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144448 00000100:00100000:0.0:1783141921.426606:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 243 00000100:00100000:0.0:1783141921.426616:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b38cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+73:12471:x1869759501144448:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783141921.426723:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b38cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+73:12471:x1869759501144448:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 108us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.426732:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 243 00000100:00100000:2.0:1783141921.431132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.431220:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144576 00000100:00100000:3.0:1783141921.431238:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144576 00000100:00100000:3.0:1783141921.431323:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:3.0:1783141921.431343:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+11:12471:x1869759501144576:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141921.431362:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141921.431380:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9ae expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.431413:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.431422:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141921.431440:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141921.431446:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.431480:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.431494:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.431508:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521105920:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141921.431655:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141921.434912:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521105920:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141921.434945:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.434964:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c74cc2200, rc 0) 00000100:00100000:3.0:1783141921.435017:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:12471:x1869759501144576:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 3686us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.435026:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783141921.436724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.436799:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144704 00000100:00100000:3.0:1783141921.436807:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144704 00010000:00010000:3.0:1783141921.436846:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.436902:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:3.0:1783141921.436931:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:2403:x1869759501144704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141921.436946:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141921.436967:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.436981:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.437004:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f67940/0xb31399d6a3807dd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a7 expref: 12 pid: 8440 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.437019:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141921.437023:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141921.437032:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.437043:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.437079:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.437093:0:9526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9526:1869759521106048:192.168.203.39@tcp:105: 00000100:00100000:3.0:1783141921.437175:0:9526:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141921.446927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.447138:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144832 00000100:00100000:0.0:1783141921.447148:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144832 00002000:00100000:0.0:1783141921.447196:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f9b44157b80 x1869759501144832/t0(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:297/0 lens 504/0 e 0 to 0 dl 1783141932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141921.447208:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b44157b80 with x1869759501144832 ext(0->12) 00002000:00010000:0.0:1783141921.447215:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b44157b80 00000100:00100000:0.0:1783141921.447252:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783141921.447262:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+12:2401:x1869759501144832:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783141921.448784:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+14:2401:x1869759501144832:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 1516us (1859us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1783141921.448796:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00002000:00100000:3.0:1783141921.448807:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f9b44157b80 x1869759501144832/t4294967321(0) o4->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:297/0 lens 504/448 e 0 to 0 dl 1783141932 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141921.448817:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b44157b80 with x1869759501144832 ext(0->12) 00002000:00010000:3.0:1783141921.448824:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b44157b80 00000100:00100000:1.0:1783141921.448987:0:9526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9526:1869759521106048:192.168.203.39@tcp:105: 00010000:00010000:1.0:1783141921.449010:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141921.449034:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2403:x1869759501144704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12106us (12318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.449042:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:1.0:1783141921.452491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.452641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501144960 00000100:00100000:2.0:1783141921.452650:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501144960 00000100:00100000:2.0:1783141921.452706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:2.0:1783141921.452714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+73:12471:x1869759501144960:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1783141921.455363:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455381:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455389:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455395:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455399:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455406:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455422:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f9b427bb200) 00010000:00010000:1.0:1783141921.455425:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.455431:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455456:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3807ade lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455489:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455496:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455502:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455508:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455512:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455519:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455528:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f9c7b5c4600) 00010000:00010000:1.0:1783141921.455531:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.455534:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455541:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a3807b86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455558:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455563:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455575:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455580:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455583:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455589:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455598:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:1.0:1783141921.455600:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.455604:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455610:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807c04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455622:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455628:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455634:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455639:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455642:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455657:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455665:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9c49ac8400) 00010000:00010000:1.0:1783141921.455668:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.455670:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455675:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807c27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455691:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455698:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455702:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455707:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455710:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455715:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455722:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141921.455724:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.455727:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455741:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3807cf9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455754:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455761:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455767:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455773:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.455775:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455781:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455789:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:1.0:1783141921.455791:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783141921.455794:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.455800:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3800/0xb31399d6a3807db6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141921.455820:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1783141921.455835:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1783141921.455872:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1783141921.456019:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521106304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783141921.456085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141921.456143:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521106304 00000100:00100000:3.0:1783141921.456151:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521106304 00000100:00100000:3.0:1783141921.456204:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783141921.456212:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759521106304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783141921.456355:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783141921.456360:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783141921 00002000:00010000:3.0:1783141921.456362:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783141921.456364:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783141921 -> 1783141921 00002000:00010000:3.0:1783141921.456366:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783141921.456403:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1869759521106304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (318us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783141921.456411:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1783141921.456452:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b44155f80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783141921.456457:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521106304:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1783141921.456471:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141921.456652:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141921.456662:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521106176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783141921.456690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783141921.456729:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9c46776f00 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:1.0:1783141921.456733:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521106176 00000020:00080000:0.0:1783141921.456735:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c7634aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c46776600 00000100:00100000:1.0:1783141921.456739:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521106176 00000020:00080000:0.0:1783141921.456741:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c7634ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b43681200 00000100:00100000:1.0:1783141921.456772:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1783141921.456781:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:1.0:1783141921.456782:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521106176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783141921.456802:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1783141921.456820:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783141921.456824:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9b43411cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783141921.456834:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c616eec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b434110c0 00000020:00080000:0.0:1783141921.456839:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9c616ee200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c76379600 00010000:00010000:1.0:1783141921.456846:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 12 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783141921.456851:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:1.0:1783141921.456856:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783141921.456861:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141921.456866:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.456903:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 12 pid: 8865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.456917:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 12 pid: 8865 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.456928:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521106432:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783141921.457002:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c76310780 going to sleep for 11 seconds 00000020:00080000:2.0:1783141921.457468:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1783141921.457514:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783141921.457602:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12471:x1869759501144960:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 4886us (5117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.457612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:0.0:1783141921.457735:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521106560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783141921.457770:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.458780:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521106560 00000100:00100000:2.0:1783141921.458790:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521106560 00000100:00100000:2.0:1783141921.458844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783141921.458853:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3655:x1869759521106560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783141921.458887:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1783141921.458919:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a489620, atime: 0x6a489621, ctime: 0x6a489620, blocks: 0x8 00010000:00010000:2.0:1783141921.458927:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.458941:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1783141921.458945:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141921.458951:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.458984:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.458994:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459002:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459019:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141921.459165:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3655:x1869759521106560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 312us (1393us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783141921.459172:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1783141921.459192:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141921.459198:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459206:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141921.459210:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459219:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459236:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459249:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a3807de7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.459302:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.459304:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.459305:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783141921.459335:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b44235500/2, rc 0, transno 4294967311 00000100:00100000:2.0:1783141921.459342:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521106560:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1783141921.459358:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141921.464745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.464903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141921.465004:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145216 00000100:00100000:1.0:1783141921.465014:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145216 00010000:00010000:1.0:1783141921.465063:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 13 pid: 8865 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.465113:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:1.0:1783141921.465121:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2402:x1869759501145216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141921.465138:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141921.465145:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 13 pid: 8865 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.465158:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 13 pid: 8865 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.465184:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141921.465189:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141921.465194:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.465203:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.465223:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141921.465308:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2402:x1869759501145216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.465317:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:3.0:1783141921.465624:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145088 00000100:00100000:3.0:1783141921.465630:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145088 00000100:00100000:3.0:1783141921.465673:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:3.0:1783141921.465681:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+13:2403:x1869759501145088:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1783141921.465713:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009353f2df/0xb31399d6a3807b94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e906 expref: 13 pid: 8865 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.465729:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1869759521106432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141921.465752:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465762:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465768:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465778:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465795:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465812:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141921.465864:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141921.465870:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465890:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fa00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141921.465894:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465904:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465917:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465924:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d967fe9/0xb31399d6a3807de0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.465940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.465942:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.465943:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783141921.467457:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1783141921.467472:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1783141921.467638:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501145088:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 1953us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.467648:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:2.0:1783141921.468677:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521106176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11893us (11981us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1783141921.468699:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141921.468852:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1783141921.468858:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1783141921.468899:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b44155f80, transno 4294967322 00000100:00100000:1.0:1783141921.468921:0:3652:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9f9b44155880 x1869759521106176/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783141937 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783141921.468932:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b44155880/2, rc 0, transno 4294967323 00000100:00100000:1.0:1783141921.468937:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521106176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783141921.471630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.471792:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145472 00000100:00100000:2.0:1783141921.471803:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145472 00000100:00100000:2.0:1783141921.471914:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:2.0:1783141921.471925:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12471:x1869759501145472:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141921.471979:0:11334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141921.472007:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1800/0xb31399d6a3807dcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9a0 expref: 21 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.472034:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:2.0:1783141921.472039:0:11334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141921.472077:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.472091:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.472100:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141921.472210:0:11334:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000feefe9d0 reply state 00000000c5a49c66 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.472222:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.472228:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:2.0:1783141921.472230:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783141921.472233:0:11334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141921.472378:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:12471:x1869759501145472:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 455us (756us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1783141921.472386:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:1.0:1783141921.475120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.475355:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145600 00000100:00100000:3.0:1783141921.475366:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145600 00000100:00100000:3.0:1783141921.475424:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:3.0:1783141921.475434:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501145600:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783141921.475570:0:8865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783141921.475574:0:8865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783141921 -> 1783141921 00002000:00010000:3.0:1783141921.475577:0:8865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783141921 00002000:00010000:3.0:1783141921.475579:0:8865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783141921 -> 1783141921 00002000:00010000:3.0:1783141921.475581:0:8865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783141921.475640:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501145600:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 207us (529us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783141921.475647:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:1.0:1783141921.479115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.479264:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145856 00000100:00100000:0.0:1783141921.479296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145856 00000100:00100000:0.0:1783141921.479466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:0.0:1783141921.479476:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:12471:x1869759501145856:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783141921.479542:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.479559:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 22 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.479568:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.479602:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 22 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.479615:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 22 pid: 11334 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.479631:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521106688:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783141921.479706:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141921.485518:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869759521106688:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141921.485549:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.487330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.487935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501145984 00000100:00100000:0.0:1783141921.487944:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501145984 00010000:00010000:0.0:1783141921.487996:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 23 pid: 11334 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.488052:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:0.0:1783141921.488063:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+23:2403:x1869759501145984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141921.488077:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.488083:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 23 pid: 11334 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488096:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 23 pid: 11334 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488117:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807daf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e992 expref: 23 pid: 11334 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488132:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:0.0:1783141921.488137:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488145:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488152:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.488187:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141921.488448:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2403:x1869759501145984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 385us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.488456:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 104 00010000:00010000:1.0:1783141921.488945:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.488955:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.488995:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489002:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489009:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489016:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.489020:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489027:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489045:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:1.0:1783141921.489059:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783141921.489063:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.489070:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f200/0xb31399d6a3807df5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.489123:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12471:x1869759501145856:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 9647us (10015us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783141921.489132:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:1.0:1783141921.497572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.497670:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501146112 00000100:00100000:3.0:1783141921.497680:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501146112 00000100:00100000:3.0:1783141921.497777:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783141921.497788:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2400:x1869759501146112:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783141921.497830:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.497864:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.497872:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141921.497876:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141921.497890:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.497925:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.497939:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 8 pid: 8438 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.497953:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521106816:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783141921.498042:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141921.501406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.501487:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501146240 00000100:00100000:0.0:1783141921.501496:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501146240 00010000:00010000:0.0:1783141921.501535:0:9526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 9 pid: 8438 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.501575:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:0.0:1783141921.501585:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501146240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141921.501601:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.501621:0:9526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 9 pid: 8438 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.501635:0:9526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 9 pid: 8438 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.501659:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141921.501664:0:9526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141921.501669:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.501679:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.501699:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141921.501743:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+9:2403:x1869759501146240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.501751:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 105 00010000:00010000:3.0:1783141921.502245:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e874b4e1/0xb31399d6a3807dd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ae expref: 8 pid: 8438 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.502262:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1869759521106816:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783141921.502322:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502344:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502366:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502390:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502399:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502409:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502416:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783141921.502420:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502429:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502443:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.502450:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000148b5111/0xb31399d6a3807dfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.502522:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2400:x1869759501146112:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 4736us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.502531:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:1.0:1783141921.505395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.505488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501146496 00000100:00100000:2.0:1783141921.505497:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501146496 00000100:00100000:2.0:1783141921.505559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 247 00000100:00100000:2.0:1783141921.505568:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:12471:x1869759501146496:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141921.505646:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.505663:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 21 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.505672:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.505707:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 21 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.505720:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 21 pid: 7934 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.505734:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521106944:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141921.505817:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e5ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141921.508810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.508927:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521106944:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141921.508953:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.509080:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501146624 00000100:00100000:0.0:1783141921.509093:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501146624 00010000:00010000:0.0:1783141921.509124:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 22 pid: 7934 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.509159:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:0.0:1783141921.509166:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2402:x1869759501146624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141921.509180:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.509185:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 22 pid: 7934 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509197:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 22 pid: 7934 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509219:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc2800/0xb31399d6a3807cf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e95a expref: 22 pid: 7934 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509233:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:0.0:1783141921.509250:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509260:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509268:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509307:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.509438:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141921.509482:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:2402:x1869759501146624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 315us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.509490:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 106 00010000:00010000:2.0:1783141921.510736:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.510750:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.510996:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.511013:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.511022:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.511055:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.511069:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 21 pid: 6524 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.511085:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521107072:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141921.511179:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e5e840 going to sleep for 11 seconds 00000100:00100000:1.0:1783141921.514707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.514765:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501146752 00000100:00100000:0.0:1783141921.514773:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501146752 00010000:00010000:0.0:1783141921.514810:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 22 pid: 6524 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141921.514848:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:0.0:1783141921.514857:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2403:x1869759501146752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141921.514871:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141921.515065:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 22 pid: 6524 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.515082:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 22 pid: 6524 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.515103:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:0.0:1783141921.515108:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.515119:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.515126:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141921.515161:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141921.515249:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2403:x1869759501146752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 392us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.515257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 107 00010000:00010000:2.0:1783141921.515463:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e600/0xb31399d6a3807dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e999 expref: 21 pid: 6524 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.515481:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521107072:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783141921.515500:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.515516:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.515522:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141921.515615:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1783141921.515705:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1783141921.515732:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1783141921.515790:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1869759521107200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783141921.515833:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.516250:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b71a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141921.519479:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107200 00000100:00100000:0.0:1783141921.519493:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107200 00000100:00100000:0.0:1783141921.519595:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783141921.519605:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1869759521107200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783141921.519743:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1869759521107200:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.519751:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783141921.519838:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1869759521107200:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783141921.519996:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1783141921.520088:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44154e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1869759521107328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783141921.520128:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141921.520509:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141921.520649:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107328 00000100:00100000:2.0:1783141921.520655:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107328 00000100:00100000:2.0:1783141921.520683:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783141921.520689:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1869759521107328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783141921.520827:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1869759521107328:12345-0@lo:1000:mdt00_001.0 Request processed in 138us (699us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783141921.520834:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783141921.520940:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44154e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1869759521107328:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783141921.520978:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.520989:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.520997:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521002:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141921.521007:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521014:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521030:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:3.0:1783141921.521033:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141921.521049:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521057:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3807e0a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521088:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521094:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521101:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521106:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783141921.521109:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521115:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521122:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141921.521125:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141921.521132:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521143:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521153:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.521187:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141921.521477:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521107456:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783141921.521591:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141921.524159:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869759521107456:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783141921.524192:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524202:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807d4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524244:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524307:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524320:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524339:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524346:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524353:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524359:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141921.524363:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524370:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524381:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141921.524385:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141921.524389:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524395:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e11 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524413:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524425:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524431:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524436:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141921.524439:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524446:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141921.524456:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141921.524458:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.524463:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e03 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.524609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:12471:x1869759501146496:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 19040us (19220us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1783141921.524620:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 247 00000020:00080000:2.0:1783141921.524626:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783141921.524763:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141921.524768:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141921.525299:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783141921.525308:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141921.528104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.528174:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147008 00000100:00100000:3.0:1783141921.528183:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147008 00000100:00100000:3.0:1783141921.528234:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:3.0:1783141921.528249:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+24:12471:x1869759501147008:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783141921.528609:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783141921.528636:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1783141921.528664:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528679:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528689:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528698:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528705:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528724:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141921.528775:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783141921.528863:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12471:x1869759501147008:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 613us (766us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783141921.528871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000020:00080000:3.0:1783141921.528930:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783141921.532371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.532888:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147136 00000100:00100000:3.0:1783141921.532899:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147136 00000100:00100000:3.0:1783141921.532956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:3.0:1783141921.532966:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12470:x1869759501147136:12345-192.168.203.39@tcp:49:lfs.0 00000100:00100000:3.0:1783141921.533083:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12470:x1869759501147136:12345-192.168.203.39@tcp:49:lfs.0 Request processed in 118us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.533091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00010000:00010000:2.0:1783141921.536549:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141921.536562:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.536573:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141921.536593:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.536604:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.536623:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:2.0:1783141921.536626:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783141921.536630:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.536635:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c74cc3400/0xb31399d6a3807e18 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.536651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.536652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141921.536654:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141921.540537:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141921.540561:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521107584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141921.540630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.542437:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107584 00000100:00100000:2.0:1783141921.542446:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107584 00000100:00100000:2.0:1783141921.542506:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783141921.542515:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3653:x1869759521107584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141921.542539:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141921.542602:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3653:x1869759521107584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.542611:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783141921.542731:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141921.542745:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521107712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141921.542779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141921.542903:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521107584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141921.543047:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521108224:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.543090:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521108736:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.543139:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141921.543145:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521108096:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.543187:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521108608:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141921.543231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108096 00000100:00100000:2.0:1783141921.543235:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108096 00000100:00100000:2.0:1783141921.543265:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783141921.543296:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521108096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543349:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521108096:12345-0@lo:400:kworker.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.543356:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783141921.543381:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521108096:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543404:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108224 00000100:00100000:2.0:1783141921.543407:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108224 00000100:00100000:2.0:1783141921.543430:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108736 00000100:00100000:2.0:1783141921.543432:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108736 00000100:00080000:2.0:1783141921.543449:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141921.543468:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1783141921.543473:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521108224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543505:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1869759521108224:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.543512:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1783141921.543532:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1869759521108224:0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543551:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783141921.543557:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521108736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141921.543597:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1869759521108736:12345-0@lo:400:kworker.0 Request processed in 41us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.543603:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783141921.543624:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1869759521108736:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.543690:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521107968:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.543719:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141921.543743:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521108480:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.543763:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141921.543778:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783141921.543783:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521107840:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.543807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141921.543843:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521108352:0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.543845:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107712 00000100:00100000:3.0:1783141921.543851:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107712 00000100:00100000:0.0:1783141921.543868:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141921.543893:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521108864:0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.543911:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783141921.543916:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141921.543924:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521107712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783141921.543941:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141921.543942:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107968 00000100:00100000:0.0:1783141921.543947:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107968 00000100:00100000:0.0:1783141921.543973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108480 00000100:00100000:0.0:1783141921.543975:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108480 00000100:00100000:3.0:1783141921.543983:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521107712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.543989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108352 00000100:00100000:3.0:1783141921.543993:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783141921.543994:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108352 00000100:00100000:0.0:1783141921.544011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108864 00000100:00100000:0.0:1783141921.544013:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108864 00000100:00080000:3.0:1783141921.544014:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141921.544019:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783141921.544022:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141921.544031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1783141921.544041:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.544043:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521108608 00000100:00100000:3.0:1783141921.544049:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521108608 00000100:00100000:3.0:1783141921.544084:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783141921.544090:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521107968:12345-0@lo:400:kworker.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.544094:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521108608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.544104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1783141921.544136:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521107968:0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.544141:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521108608:12345-0@lo:400:kworker.0 Request processed in 48us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141921.544149:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783141921.544162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1783141921.544167:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141921.544171:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521108480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.544190:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521108608:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.544212:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521108480:12345-0@lo:400:kworker.0 Request processed in 41us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.544219:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00080000:0.0:1783141921.544247:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44234a80 x1869759521108480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141921.544257:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521108480:0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.544312:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1783141921.544319:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521108352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.544363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1869759521108352:12345-0@lo:400:kworker.0 Request processed in 44us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.544369:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1783141921.544381:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783141921.544387:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141921.544410:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521108864:12345-0@lo:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.544416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783141921.544532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521107840 00000100:00100000:1.0:1783141921.544537:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521107840 00000100:00100000:1.0:1783141921.544575:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1783141921.544582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521107840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141921.544614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521107840:12345-0@lo:400:kworker.0 Request processed in 34us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.544621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1783141921.544667:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521107712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141921.544764:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521107840:0@lo:400:kworker.0 00000100:00100000:3.0:1783141921.544775:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521108352:0@lo:400:kworker.0 00010000:00080000:3.0:1783141921.544784:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44234700 x1869759521108864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141921.544793:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521108864:0@lo:400:kworker.0 00000100:00100000:1.0:1783141921.547679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141921.547763:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147392 00000100:00100000:0.0:1783141921.547773:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147392 00000100:00100000:0.0:1783141921.547827:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 248 00000100:00100000:0.0:1783141921.547837:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12470:x1869759501147392:12345-192.168.203.39@tcp:58:lfs.0 00000040:00080000:0.0:1783141921.548004:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783141921.548084:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12470:x1869759501147392:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 249us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141921.548093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 248 00000100:00100000:1.0:1783141921.577081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.577685:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147520 00000100:00100000:2.0:1783141921.577697:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147520 00000100:00100000:2.0:1783141921.577754:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:2.0:1783141921.577763:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+26:12473:x1869759501147520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783141921.577784:0:7934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141921.577803:0:7934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9b5 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577863:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577891:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577903:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577918:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577925:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.577930:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.578022:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.578033:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.578041:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.578074:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.578087:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 27 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.578099:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521108992:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783141921.578183:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140840 going to sleep for 11 seconds 00000100:00100000:2.0:1783141921.580985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141921.581062:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147776 00000100:00100000:3.0:1783141921.581071:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147776 00000100:00100000:3.0:1783141921.581125:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:3.0:1783141921.581134:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:6168:x1869759501147776:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783141921.581395:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:6168:x1869759501147776:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 261us (417us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783141921.581403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783141921.581775:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7934:1869759521108992:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783141921.581799:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141921.586039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141921.586136:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501147904 00000100:00100000:2.0:1783141921.586145:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501147904 00010000:00010000:2.0:1783141921.586184:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141921.586228:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:2.0:1783141921.586239:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:2402:x1869759501147904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141921.586253:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141921.586260:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586319:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586340:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3807d3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e976 expref: 29 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586357:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141921.586362:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586371:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586379:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141921.586409:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141921.586458:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:2402:x1869759501147904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141921.586466:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 108 00010000:00010000:1.0:1783141921.586529:0:7934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586537:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141921.586587:0:7934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783141921.586591:0:7934:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783141921.586610:0:7934:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586623:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586633:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586639:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586646:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586652:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.586663:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586671:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586681:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:1.0:1783141921.586684:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.586688:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586694:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a3807e26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586705:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586711:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586717:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586722:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141921.586725:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586731:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586738:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f9b4218b700) 00010000:00010000:1.0:1783141921.586740:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141921.586750:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586757:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0800/0xb31399d6a3807e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586791:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1e00/0xb31399d6a3807e1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9b5 expref: 28 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586806:0:7934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9b5 expref: 27 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141921.586813:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141921.586815:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141921.586817:0:7934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:1.0:1783141921.586841:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12473:x1869759501147520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 9079us (9771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141921.586848:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 249 00010000:00010000:2.0:1783141921.668497:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141922.059054:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141922.059077:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521109120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783141922.059145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141922.059210:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109120 00000100:00100000:1.0:1783141922.059217:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109120 00000100:00100000:1.0:1783141922.059260:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783141922.059268:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521109120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783141922.059328:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783141922.059369:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521109120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141922.059376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783141922.059429:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521109120:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1783141922.290188:0:14709:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141922.290198:0:14709:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783141922.290229:0:14709:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783141922.290235:0:14709:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783141922.565599:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141922.565608:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783141922.565646:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783141922.565665:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141922.565778:0:13801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442ca680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521109248:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141922.565879:0:13801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c46776900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141922.566245:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141922.566260:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521109376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141922.566327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141922.566506:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109376 00000100:00100000:3.0:1783141922.566514:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109376 00000100:00100000:3.0:1783141922.566565:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783141922.566573:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1869759521109376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141922.566601:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1783141922.566711:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1869759521109376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141922.566719:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783141922.567235:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521109376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141922.571215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141922.571369:0:13801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442ca680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1869759521109248:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783141922.573748:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501148032 00000100:00100000:2.0:1783141922.573761:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501148032 00000100:00100000:2.0:1783141922.574147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:2.0:1783141922.574158:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12486:x1869759501148032:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141922.574206:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141922.574364:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12486:x1869759501148032:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 207us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141922.574373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:3.0:1783141922.579853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141922.579927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501148288 00000100:00100000:1.0:1783141922.579938:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501148288 00000100:00100000:1.0:1783141922.580072:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:1.0:1783141922.580084:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+27:12486:x1869759501148288:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141922.580104:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141922.580123:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807e3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9bc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141922.580228:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141922.580245:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141922.580258:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141922.580293:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783141922.580400:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168fa00/0xb31399d6a3807e3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9bc expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141922.580421:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9bc expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141922.580430:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141922.580446:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141922.580450:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e400, rc 0) 00000100:00100000:1.0:1783141922.580519:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:12486:x1869759501148288:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 437us (674us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1783141922.580527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:3.0:1783141922.584916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141922.584967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141922.585006:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501148416 00000100:00100000:3.0:1783141922.585015:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501148416 00000100:00100000:3.0:1783141922.585077:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783141922.585096:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:2402:x1869759501148416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141922.585112:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141922.585135:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9bc expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141922.585156:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141922.585162:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141922.585210:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:2402:x1869759501148416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 123us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141922.585220:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:2.0:1783141922.587788:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501148672 00000100:00100000:2.0:1783141922.587802:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501148672 00000100:00100000:2.0:1783141922.587892:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:2.0:1783141922.587903:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+28:12486:x1869759501148672:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141922.587990:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.588006:0:7934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.588019:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589180:0:7934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589194:0:7934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589200:0:7934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589206:0:7934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783141922.589210:0:7934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589236:0:7934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589252:0:7934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:2.0:1783141922.589255:0:7934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141922.589261:0:7934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141922.589268:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0400/0xb31399d6a3807e50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141922.589431:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:12486:x1869759501148672:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 1526us (4520us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1783141922.589441:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 252 00000040:00080000:3.0:1783141922.592379:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141922.592390:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141922.592905:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783141922.592916:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141922.602008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141922.602083:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501148928 00000100:00100000:0.0:1783141922.602094:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501148928 00000100:00100000:0.0:1783141922.602156:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1783141922.602166:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+29:12486:x1869759501148928:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783141922.602419:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:12486:x1869759501148928:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 254us (419us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783141922.602427:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00010000:00010000:2.0:1783141922.692514:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141923.079094:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141923.079116:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521109504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141923.079190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141923.079309:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109504 00000100:00100000:0.0:1783141923.079317:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109504 00000100:00100000:0.0:1783141923.079365:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783141923.079375:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521109504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141923.079400:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783141923.079440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521109504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141923.079447:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1783141923.079466:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783141923.081673:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1783141923.081686:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1783141923.081859:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521109504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141923.716520:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141923.956193:0:14760:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141923.958509:0:14760:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141923.958571:0:14760:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783141923.958579:0:14760:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141924.154070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141924.154218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149184 00000100:00100000:1.0:1783141924.154228:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149184 00000100:00100000:1.0:1783141924.154322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 253 00000100:00100000:1.0:1783141924.154333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+30:12506:x1869759501149184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783141924.154356:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141924.154379:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9c3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.154485:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807e5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.154499:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.154511:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141924.154521:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783141924.154612:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168f400/0xb31399d6a3807e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9c3 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.154630:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807e5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9c3 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.154648:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141924.154651:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783141924.154654:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168ea00, rc 0) 00000100:00100000:1.0:1783141924.154709:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:12506:x1869759501149184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 378us (647us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1783141924.154716:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 253 00000100:00080000:3.0:1783141924.155046:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141924.159163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141924.159503:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149312 00000100:00100000:1.0:1783141924.159512:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149312 00000100:00100000:1.0:1783141924.159774:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 254 00000100:00100000:1.0:1783141924.159785:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:12506:x1869759501149312:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:1.0:1783141924.159872:0:11334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159890:0:11334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159900:0:11334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159932:0:11334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159938:0:11334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159944:0:11334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159950:0:11334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783141924.159964:0:11334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159971:0:11334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159983:0:11334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:1.0:1783141924.159985:0:11334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141924.159989:0:11334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.159995:0:11334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168e400/0xb31399d6a3807e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141924.160062:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:12506:x1869759501149312:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 279us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.160070:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 254 00000100:00100000:1.0:1783141924.241875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141924.241991:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149440 00000100:00100000:2.0:1783141924.242000:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149440 00000100:00100000:2.0:1783141924.242108:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:2.0:1783141924.242118:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2403:x1869759501149440:12345-192.168.203.39@tcp:101:cat.0 00000100:00080000:3.0:1783141924.242142:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783141924.242152:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141924.242174:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807e73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9ca expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141924.242203:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a489621, atime: 0x6a489621, ctime: 0x6a489621, blocks: 0x8 00010000:00010000:2.0:1783141924.242222:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1783141924.242227:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141924.242245:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807e73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ca expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.242264:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807e73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ca expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.242375:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:3.0:1783141924.244586:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501149440:12345-192.168.203.39@tcp:101:cat.0 Request processed in 2459us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141924.244598:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:1.0:1783141924.250593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141924.255919:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149568 00000100:00100000:3.0:1783141924.255934:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149568 00002000:00100000:3.0:1783141924.256006:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f9b4419c700 x1869759501149568/t0(0) o3->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:300/0 lens 488/0 e 0 to 0 dl 1783141935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141924.256018:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b4419c700 with x1869759501149568 ext(0->4095) 00002000:00010000:3.0:1783141924.256023:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b4419c700 00000100:00100000:3.0:1783141924.256070:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783141924.256079:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501149568:12345-192.168.203.39@tcp:3:cat.0 00000100:00100000:3.0:1783141924.256253:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2402:x1869759501149568:12345-192.168.203.39@tcp:3:cat.0 Request processed in 174us (5667us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1783141924.256261:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00002000:00100000:3.0:1783141924.256268:0:8445:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f9b4419c700 x1869759501149568/t0(0) o3->51a41658-4bb5-47ac-acec-f543eb9c9e19@192.168.203.39@tcp:300/0 lens 488/4536 e 0 to 0 dl 1783141935 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141924.256301:0:8445:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f9b4419c700 with x1869759501149568 ext(0->4095) 00002000:00010000:3.0:1783141924.256305:0:8445:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f9b4419c700 00010000:00010000:2.0:1783141924.742481:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141925.764486:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141926.150500:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141926.150526:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521109632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141926.150610:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141926.151392:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109632 00000100:00100000:2.0:1783141926.151401:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109632 00000100:00100000:2.0:1783141926.151455:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783141926.151464:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521109632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141926.151498:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141926.151550:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521109632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141926.151558:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783141926.151940:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521109632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141926.159860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.159897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.159941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.159963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.159982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.160000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.160021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141926.160048:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150208 00000100:00100000:0.0:1783141926.160059:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150208 00000100:00100000:0.0:1783141926.160115:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150080 00000100:00100000:0.0:1783141926.160118:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150080 00000100:00100000:0.0:1783141926.160140:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:0.0:1783141926.160149:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501150208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160232:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501150208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160240:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:0.0:1783141926.160258:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:0.0:1783141926.160265:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501150080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160323:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+8:2403:x1869759501150080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160329:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:0.0:1783141926.160347:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149952 00000100:00100000:0.0:1783141926.160350:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149952 00000100:00100000:0.0:1783141926.160376:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150464 00000100:00100000:0.0:1783141926.160379:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150464 00000100:00100000:0.0:1783141926.160391:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149824 00000100:00100000:0.0:1783141926.160394:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149824 00000100:00100000:0.0:1783141926.160405:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150336 00000100:00100000:0.0:1783141926.160407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150336 00000100:00100000:0.0:1783141926.160421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 303 00000100:00100000:0.0:1783141926.160436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501149952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160466:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2403:x1869759501149952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 303 00000100:00100000:0.0:1783141926.160485:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 304 00000100:00100000:0.0:1783141926.160491:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501150464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501150464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 304 00000100:00100000:0.0:1783141926.160532:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 305 00000100:00100000:0.0:1783141926.160538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:2403:x1869759501149824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160561:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+32:2403:x1869759501149824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 305 00000100:00100000:0.0:1783141926.160578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 306 00000100:00100000:0.0:1783141926.160584:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501150336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141926.160807:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2403:x1869759501150336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 222us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.160814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 306 00000100:00080000:0.0:1783141926.160852:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141926.160857:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141926.160859:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141926.160862:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141926.163500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501149696 00000100:00100000:1.0:1783141926.163514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501149696 00000100:00100000:1.0:1783141926.163577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 384 00000100:00100000:1.0:1783141926.163587:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501149696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141926.163669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2403:x1869759501149696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141926.163677:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 384 00000100:00100000:1.0:1783141926.660388:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521109760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141926.660456:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141926.660556:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109760 00000100:00100000:1.0:1783141926.660569:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109760 00000100:00100000:1.0:1783141926.660634:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1783141926.660638:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141926.660646:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521109760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783141926.660675:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141926.660865:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521109888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141926.660898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141926.661085:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521109888 00000100:00100000:3.0:1783141926.661089:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521109888 00000100:00100000:3.0:1783141926.661124:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783141926.661132:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521109888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141926.661146:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141926.661190:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521109888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141926.661198:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783141926.661245:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521110400:0@lo:400:kworker.0 00000100:00100000:2.0:1783141926.661379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141926.661405:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521110912:0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.661407:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110400 00000100:00100000:0.0:1783141926.661418:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110400 00000100:00100000:2.0:1783141926.661432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141926.661458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783141926.661462:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:0.0:1783141926.661468:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521110400:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1783141926.661469:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1783141926.661503:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b44209500, transno 4294967308 00000100:00100000:0.0:1783141926.661515:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521110400:12345-0@lo:400:kworker.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000004:00080000:2.0:1783141926.661516:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:0.0:1783141926.661526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000004:00080000:2.0:1783141926.661530:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b44235500, transno 4294967311 00000100:00100000:0.0:1783141926.661549:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110912 00000100:00100000:0.0:1783141926.661554:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110912 00000100:00100000:0.0:1783141926.661585:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783141926.661592:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521110912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141926.661600:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521109888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141926.661630:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521110400:0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.661633:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521110912:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.661642:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783141926.661646:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521110912:0@lo:400:kworker.0 00000100:00100000:2.0:1783141926.661662:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783141926.661669:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521110016:0@lo:400:kworker.0 00000100:00100000:2.0:1783141926.661697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141926.661739:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521110528:0@lo:400:kworker.0 00000100:00100000:2.0:1783141926.661761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141926.661817:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141926.661822:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141926.661953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110016 00000100:00100000:0.0:1783141926.661959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110016 00000100:00100000:0.0:1783141926.662007:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1783141926.662018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521110016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521109760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1389us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141926.662043:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783141926.662073:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521110016:12345-0@lo:400:kworker.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.662082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1783141926.662089:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521110144:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662187:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521110272:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662218:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141926.662250:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521110784:0@lo:400:kworker.0 00000100:00100000:3.0:1783141926.662300:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110272 00000100:00100000:3.0:1783141926.662306:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110272 00000100:00100000:1.0:1783141926.662311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141926.662344:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783141926.662353:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521109760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783141926.662354:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521110272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662387:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110784 00000100:00100000:1.0:1783141926.662391:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110784 00000100:00100000:3.0:1783141926.662425:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521110272:12345-0@lo:400:kworker.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141926.662432:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783141926.662441:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521110784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662478:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521110784:12345-0@lo:400:kworker.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141926.662485:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1783141926.662502:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141926.662521:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783141926.662530:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521110272:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.662544:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521110784:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.663794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141926.663813:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110528 00000100:00100000:2.0:1783141926.663817:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521111040:0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.663820:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110528 00000100:00100000:0.0:1783141926.663924:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1783141926.663932:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521110528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.663979:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521110528:12345-0@lo:400:kworker.0 Request processed in 48us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.663987:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1783141926.664013:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1783141926.667110:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1783141926.667159:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f9c4b70c600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1783141926.667165:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440add00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f9c4b70cc00 00000020:00080000:3.0:1783141926.667169:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f9b440ad200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f9b4279c200 00000100:00100000:1.0:1783141926.667183:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110144 00000020:00080000:3.0:1783141926.667205:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:1.0:1783141926.667207:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110144 00010000:00010000:3.0:1783141926.667240:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141926.667256:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141926.667296:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141926.667300:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00010000:00010000:3.0:1783141926.667318:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00000100:00100000:1.0:1783141926.667321:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521110144:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1783141926.667329:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141926.667357:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141926.667381:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f9c49ac8300) 00010000:00010000:3.0:1783141926.667385:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141926.667392:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141926.667399:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521110144:12345-0@lo:400:kworker.0 Request processed in 80us (3604us total) trans 0 rc 0/0 00010000:00010000:3.0:1783141926.667405:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3807dee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141926.667416:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783141926.667481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141926.667535:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521110016:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.667548:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521110528:0@lo:400:kworker.0 00000100:00100000:3.0:1783141926.667829:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111040 00000100:00100000:3.0:1783141926.667839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111040 00000100:00100000:3.0:1783141926.667910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000001:00080000:1.0:1783141926.667991:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1783141926.668002:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00080000:0.0:1783141926.668116:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141926.668175:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521111040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.669398:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521110144:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.669411:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521110656:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.669476:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141926.669514:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521110656 00000100:00100000:1.0:1783141926.669519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521110656 00000100:00100000:3.0:1783141926.670091:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521111040:12345-0@lo:400:kworker.0 Request processed in 1907us (2596us total) trans 0 rc 0/0 00000100:00080000:0.0:1783141926.674747:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141926.674778:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521111168:0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.674860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141926.675060:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521111040:0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.675102:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111168 00000100:00100000:0.0:1783141926.675108:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111168 00000100:00100000:0.0:1783141926.675170:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1783141926.675178:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521111168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141926.675232:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521111168:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141926.675240:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1783141926.675262:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783141926.675306:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557800 x1869759521111168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141926.675318:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521111168:0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.676085:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783141926.676098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521110656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141926.676214:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521110656:12345-0@lo:400:kworker.0 Request processed in 120us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141926.676222:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00080000:1.0:1783141926.676260:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43556680 x1869759521110656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141926.676291:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521110656:0@lo:400:kworker.0 00000020:00080000:2.0:1783141926.678486:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1783141926.678558:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1783141926.679604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:0.0:1783141926.790078:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141927.173171:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521111296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141927.173242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141927.173502:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111296 00000100:00100000:0.0:1783141927.173509:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111296 00000100:00100000:0.0:1783141927.173561:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783141927.173570:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521111296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783141927.173603:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783141927.173655:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521111296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141927.173662:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783141927.174313:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521111296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141927.684885:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141927.684914:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521111424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141927.684986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141927.685181:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111424 00000100:00100000:3.0:1783141927.685191:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111424 00000100:00100000:3.0:1783141927.685251:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783141927.685260:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521111424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141927.685307:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783141927.685363:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521111424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141927.685371:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783141927.685410:0:3653:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1783141927.685415:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f9b44155880, transno 4294967323 00000004:00080000:3.0:1783141927.685440:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1783141927.685468:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521111424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141927.813436:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141928.197545:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141928.197566:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141928.197633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141928.202659:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111552 00000100:00100000:0.0:1783141928.202673:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111552 00000100:00100000:0.0:1783141928.202757:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783141928.202770:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521111552:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783141928.202771:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783141928.202796:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783141928.203013:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521111552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141928.203021:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783141928.203147:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521111552:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783141928.836643:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141928.948966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141928.949076:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150592 00000100:00100000:1.0:1783141928.949100:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150592 00000100:00100000:1.0:1783141928.949182:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00100000:1.0:1783141928.949193:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:12159:x1869759501150592:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783141928.949389:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:12159:x1869759501150592:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 198us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141928.949398:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00080000:2.0:1783141928.949474:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141928.955676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141928.955839:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150720 00000100:00100000:2.0:1783141928.955849:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150720 00000100:00100000:2.0:1783141928.955925:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00100000:2.0:1783141928.955936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:12159:x1869759501150720:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783141928.956041:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:12159:x1869759501150720:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 106us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141928.956048:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00080000:0.0:1783141928.956120:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141928.958031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141928.959596:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501150976 00000100:00100000:1.0:1783141928.959608:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501150976 00000100:00100000:1.0:1783141928.959726:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:1.0:1783141928.959736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:12159:x1869759501150976:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783141928.960120:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:12159:x1869759501150976:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 384us (2095us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1783141928.960137:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:3.0:1783141929.183114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141929.183338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151104 00000100:00100000:0.0:1783141929.183352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151104 00000100:00100000:0.0:1783141929.183447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00100000:0.0:1783141929.183460:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:12963:x1869759501151104:12345-192.168.203.39@tcp:101:lsof.0 00010000:00010000:0.0:1783141929.183488:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141929.183515:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9d1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183595:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183613:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183629:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141929.183711:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783141929.183715:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783141929.183745:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183775:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e200/0xb31399d6a3807e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9d1 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183797:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9d1 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141929.183807:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:0.0:1783141929.183810:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141929.183815:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e000, rc 0) 00000100:00100000:0.0:1783141929.183910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:12963:x1869759501151104:12345-192.168.203.39@tcp:101:lsof.0 Request processed in 453us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141929.183919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00080000:2.0:1783141929.184078:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141929.862558:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141930.699933:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783141930.820669:0:13801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141930.820683:0:13801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783141930.820799:0:13801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1783141930.820808:0:13801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783141930.885472:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141931.268870:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521111680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141931.268980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.269715:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111680 00000100:00100000:2.0:1783141931.269727:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111680 00000100:00100000:2.0:1783141931.269802:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783141931.269825:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521111680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783141931.269873:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783141931.269953:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521111680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.269962:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783141931.270727:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521111680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783141931.270867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141931.270910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141931.270997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141931.271029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141931.271097:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151744 00000100:00100000:3.0:1783141931.271103:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151744 00000100:00100000:3.0:1783141931.271159:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783141931.271168:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501151744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141931.271238:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501151744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141931.271245:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00080000:3.0:1783141931.271267:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141931.271881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151232 00000100:00100000:0.0:1783141931.271888:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151232 00000100:00100000:0.0:1783141931.271944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 386 00000100:00100000:0.0:1783141931.271952:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501151232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141931.272014:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2402:x1869759501151232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 62us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.272021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 386 00000100:00100000:2.0:1783141931.276562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141931.276862:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151488 00000100:00100000:1.0:1783141931.276876:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151488 00000100:00100000:1.0:1783141931.277891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501152000 00000100:00100000:1.0:1783141931.277902:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501152000 00000100:00100000:2.0:1783141931.278027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141931.278061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141931.278157:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151616 00000100:00100000:2.0:1783141931.278162:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151616 00000100:00080000:0.0:1783141931.282608:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141931.282625:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783141931.282663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151360 00000100:00100000:0.0:1783141931.282678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151360 00000100:00100000:0.0:1783141931.282763:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501151872 00000100:00100000:0.0:1783141931.282767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501151872 00000100:00100000:0.0:1783141931.282793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 313 00000100:00100000:0.0:1783141931.282805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501151488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141931.282947:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2402:x1869759501151488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 143us (12034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.282962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 313 00000100:00100000:0.0:1783141931.282986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 314 00000100:00100000:0.0:1783141931.282994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:2402:x1869759501151360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141931.283034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:2402:x1869759501151360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (6488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.283042:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 314 00000100:00100000:0.0:1783141931.283055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 315 00000100:00100000:0.0:1783141931.283061:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501151872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141931.283101:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2402:x1869759501151872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (5039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.283107:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 315 00000100:00080000:0.0:1783141931.283124:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141931.284177:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 316 00000100:00100000:1.0:1783141931.284190:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501152000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783141931.284269:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2402:x1869759501152000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (13238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141931.284294:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 316 00000100:00100000:2.0:1783141931.285444:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:2.0:1783141931.285458:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501151616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783141931.285551:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2402:x1869759501151616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 96us (7528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.285561:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:2.0:1783141931.780726:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141931.780760:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521111808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141931.780870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.781052:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111808 00000100:00100000:0.0:1783141931.781062:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111808 00000100:00100000:0.0:1783141931.781139:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783141931.781148:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521111808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783141931.781184:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141931.781241:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521111808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.781248:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783141931.781329:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521111808:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783141931.781427:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141931.781572:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141931.781584:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521111936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141931.781622:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.781650:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521111936 00000100:00100000:0.0:1783141931.781653:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521111936 00000100:00100000:0.0:1783141931.781685:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783141931.781692:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521111936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141931.781705:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141931.781738:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521111936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.781745:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1783141931.782044:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141931.782070:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521111936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141931.785778:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521112320:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.785888:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.785951:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521112832:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.785979:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.786027:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783141931.786034:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521112192:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786065:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.786084:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521112704:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786109:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.786126:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521113216:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786151:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141931.786185:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112320 00000100:00100000:0.0:1783141931.786195:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112320 00000100:00100000:0.0:1783141931.786254:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783141931.786265:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521112320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786362:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521112320:12345-0@lo:400:kworker.0 Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.786370:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783141931.786395:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112832 00000100:00100000:0.0:1783141931.786398:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112832 00000100:00100000:0.0:1783141931.786435:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783141931.786442:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521112832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786475:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521112832:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.786482:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783141931.786515:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112192 00000100:00100000:0.0:1783141931.786519:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112192 00000100:00100000:0.0:1783141931.786544:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112704 00000100:00100000:0.0:1783141931.786546:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112704 00000100:00100000:0.0:1783141931.786567:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113216 00000100:00100000:0.0:1783141931.786570:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113216 00000100:00100000:0.0:1783141931.786584:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783141931.786597:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521112192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786629:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1869759521112192:12345-0@lo:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.786636:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783141931.786654:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783141931.786660:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521112704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786686:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1869759521112704:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.786691:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783141931.786704:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783141931.786709:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786736:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521113216:12345-0@lo:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141931.786742:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:0.0:1783141931.786777:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141931.786782:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141931.786834:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1869759521112192:0@lo:400:kworker.0 00010000:00080000:0.0:1783141931.786849:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767100 x1869759521112704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141931.786860:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1869759521112704:0@lo:400:kworker.0 00010000:00080000:0.0:1783141931.786871:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767b80 x1869759521113216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141931.786880:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521113216:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786889:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521112320:0@lo:400:kworker.0 00000100:00100000:0.0:1783141931.786909:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521112832:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787056:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521112448:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787096:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.787130:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521112960:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.787177:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783141931.787184:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521112064:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.787241:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521112576:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.787303:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521113088:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141931.787368:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112960 00000100:00100000:2.0:1783141931.787373:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112960 00000100:00100000:2.0:1783141931.787415:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783141931.787423:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521112960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521112960:12345-0@lo:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.787474:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783141931.787496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112064 00000100:00100000:2.0:1783141931.787500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112064 00000100:00100000:2.0:1783141931.787528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783141931.787535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521112064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3652:x1869759521112064:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.787573:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783141931.787609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112448 00000100:00100000:2.0:1783141931.787613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112448 00000100:00100000:2.0:1783141931.787636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521112576 00000100:00100000:2.0:1783141931.787639:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521112576 00000100:00100000:2.0:1783141931.787654:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113088 00000100:00100000:2.0:1783141931.787656:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113088 00000100:00100000:2.0:1783141931.787670:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783141931.787676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521112448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521112448:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.787715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1783141931.787727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783141931.787734:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521112576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521112576:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.787775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783141931.787788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783141931.787794:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521113088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787839:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521113088:12345-0@lo:400:kworker.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141931.787845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:2.0:1783141931.787865:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141931.787870:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141931.787890:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521112064:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787902:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521112576:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787912:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521113088:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787921:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521112448:0@lo:400:kworker.0 00000100:00100000:2.0:1783141931.787929:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521112960:0@lo:400:kworker.0 00010000:00010000:2.0:1783141931.908941:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141932.295851:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521113344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141932.295923:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141932.296019:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113344 00000100:00100000:2.0:1783141932.296027:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113344 00000100:00100000:2.0:1783141932.296070:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783141932.296078:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521113344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783141932.296109:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783141932.296234:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521113344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141932.296242:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783141932.296535:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521113344:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1783141932.331564:0:14957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:12:11 (1783141931) 00000100:00100000:3.0:1783141932.805775:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521113472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141932.805854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141932.807433:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113472 00000100:00100000:0.0:1783141932.807445:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113472 00000100:00100000:0.0:1783141932.807498:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783141932.807507:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521113472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141932.807535:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783141932.807603:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521113472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141932.807610:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783141932.809688:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521113472:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1783141932.814849:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1783141932.814874:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783141932.814993:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783141932.815007:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1783141932.932491:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141933.316643:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521113600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141933.316721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141933.316908:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113600 00000100:00100000:0.0:1783141933.316916:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113600 00000100:00100000:0.0:1783141933.316986:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783141933.316997:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521113600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141933.317019:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783141933.317081:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521113600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141933.317088:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1783141933.317331:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141933.317669:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521113600:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141933.957074:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141934.980504:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141935.629848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141935.630022:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501152256 00000100:00100000:1.0:1783141935.630240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501152256 00000100:00100000:1.0:1783141935.630362:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1783141935.630373:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+18:13186:x1869759501152256:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:1.0:1783141935.630630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:13186:x1869759501152256:12345-192.168.203.39@tcp:35:umount.0 Request processed in 258us (790us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1783141935.630639:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00080000:3.0:1783141935.631303:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141935.632815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141935.632966:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501152512 00000100:00100000:0.0:1783141935.632976:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501152512 00000100:00100000:0.0:1783141935.633036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1783141935.633046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+19:13186:x1869759501152512:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:0.0:1783141935.633817:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:13186:x1869759501152512:12345-192.168.203.39@tcp:35:umount.0 Request processed in 768us (1006us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783141935.633827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783141935.644682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141935.644938:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501152768 00000100:00100000:0.0:1783141935.644948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501152768 00000100:00100000:0.0:1783141935.645090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:0.0:1783141935.645101:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c79a23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+20:13186:x1869759501152768:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:0.0:1783141935.645360:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c79a23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:13186:x1869759501152768:12345-192.168.203.39@tcp:35:umount.0 Request processed in 260us (688us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1783141935.645369:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:3.0:1783141935.648835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141935.654536:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153024 00000100:00100000:1.0:1783141935.654550:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153024 00000100:00100000:1.0:1783141935.654619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:1.0:1783141935.654630:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+21:13186:x1869759501153024:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:1.0:1783141935.655519:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:13186:x1869759501153024:12345-192.168.203.39@tcp:35:umount.0 Request processed in 888us (6688us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1783141935.655531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:1.0:1783141935.663114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141935.663159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141935.663260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141935.667850:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153152 00000100:00100000:3.0:1783141935.667864:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153152 00000100:00100000:0.0:1783141935.668113:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153408 00000100:00100000:0.0:1783141935.668118:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153408 00000100:00100000:0.0:1783141935.668151:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153280 00000100:00100000:0.0:1783141935.668155:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153280 00000100:00100000:0.0:1783141935.668183:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783141935.668194:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+15:2400:x1869759501153152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141935.668210:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141935.668229:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cc200/0xb31399d6a3806e58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e524 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.668254:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141935.668332:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+14:2400:x1869759501153152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 139us (5359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.668340:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783141935.668356:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783141935.668362:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+13:2400:x1869759501153408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141935.668381:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141935.668390:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b4407f600/0xb31399d6a38070ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5fd expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.668399:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141935.668417:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+12:2400:x1869759501153408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 55us (5259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.668423:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783141935.668437:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783141935.668443:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2400:x1869759501153280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141935.668450:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141935.668458:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2e00/0xb31399d6a3806d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e4e5 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.668466:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141935.668484:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501153280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 42us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.668490:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783141935.669506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141935.669574:0:8865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153536 00000100:00100000:1.0:1783141935.669583:0:8865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153536 00000100:00100000:1.0:1783141935.669633:0:8865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:1.0:1783141935.669641:0:8865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2399:x1869759501153536:12345-192.168.203.39@tcp:9:umount.0 00000020:00000080:1.0:1783141935.669667:0:8865:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3807176 00000100:00080000:1.0:1783141935.669675:0:8865:0:(import.c:65:import_set_state_nolock()) ffff9f9c4a2f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783141935.669831:0:8865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1783141935.670257:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141935.670266:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141935.670408:0:8865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51a41658-4bb5-47ac-acec-f543eb9c9e19+2:2399:x1869759501153536:12345-192.168.203.39@tcp:9:umount.0 Request processed in 766us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.670417:0:8865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:2.0:1783141935.677006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141935.678175:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501153920 00000100:00100000:0.0:1783141935.678187:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501153920 00000100:00100000:0.0:1783141935.678266:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:0.0:1783141935.678302:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2399:x1869759501153920:12345-192.168.203.39@tcp:9:umount.0 00000020:00000080:0.0:1783141935.678331:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38073e5 00000020:00010000:0.0:1783141935.678338:0:8438:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f9b4372d800: total 0 00000100:00080000:0.0:1783141935.678342:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9f9b4372c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141935.678385:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:3.0:1783141935.678547:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f9b4372d800: total 0 00010000:00010000:3.0:1783141935.678596:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f9b4372d800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783141935.678657:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aad2eda/0xb31399d6a3807e73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ca expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.678689:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050d8473e/0xb31399d6a38077a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e7 expref: 5 pid: 8865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.678704:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f9b4372d800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783141935.678716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141935.678718:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141935.678720:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141935.679014:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+2:2399:x1869759501153920:12345-192.168.203.39@tcp:9:umount.0 Request processed in 738us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.679022:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00080000:2.0:1783141935.681766:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141935.689915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141935.689991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501154944 00000100:00100000:0.0:1783141935.690001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501154944 00000100:00100000:0.0:1783141935.690060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:0.0:1783141935.690070:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+22:2399:x1869759501154944:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:0.0:1783141935.690105:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806da9 00000020:00010000:0.0:1783141935.690119:0:6522:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f9c7c5d7800: total 0 00000100:00080000:0.0:1783141935.690124:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141935.690153:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1783141935.690504:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f9c7c5d7800: total 0 00010000:00010000:3.0:1783141935.690509:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141935.690554:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f9c7c5d7800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783141935.690582:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141935.690585:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141935.690593:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd600/0xb31399d6a380780d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e803 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.690614:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141935.690616:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783141935.690620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c4168ea00/0xb31399d6a3807e5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9c3 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.690633:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141935.690635:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783141935.691100:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407ee00/0xb31399d6a380714c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e627 expref: 19 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691136:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141935.691139:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141935.691143:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3807765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7d2 expref: 18 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691156:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141935.691158:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141935.691161:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0600/0xb31399d6a3807b16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e8e3 expref: 17 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691173:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f9c7b5c1d00) 00010000:00010000:3.0:1783141935.691175:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141935.691179:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cd000/0xb31399d6a3807447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e700 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691196:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9c7b5c1c00) 00010000:00010000:3.0:1783141935.691199:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141935.691203:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407f000/0xb31399d6a38070f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e612 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691217:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141935.691219:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141935.691224:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e400/0xb31399d6a3807d54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e97d expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691245:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141935.691248:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783141935.691259:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407fa00/0xb31399d6a380778f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e7e0 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691293:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f9c7b5c1500) 00010000:00010000:3.0:1783141935.691295:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783141935.691298:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cde00/0xb31399d6a3807829 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e80a expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691313:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c4d337300) 00010000:00010000:3.0:1783141935.691315:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141935.691318:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc000/0xb31399d6a38070d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e60b expref: 11 pid: 11334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691333:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f9b4218b000) 00010000:00010000:3.0:1783141935.691335:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141935.691339:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0c00/0xb31399d6a3807e34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9b5 expref: 10 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691351:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f9c7b5c1a00) 00010000:00010000:3.0:1783141935.691353:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141935.691357:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b424cc400/0xb31399d6a3807685 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e79a expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.691368:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f9c7c5d7800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1783141935.691388:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141935.691389:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141935.691391:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141935.691461:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51a41658-4bb5-47ac-acec-f543eb9c9e19+7:2399:x1869759501154944:12345-192.168.203.39@tcp:39:umount.0 Request processed in 1391us (1555us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1783141935.691471:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:3.0:1783141935.700955:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141935.701960:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155072 00000100:00100000:2.0:1783141935.701971:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155072 00000100:00100000:2.0:1783141935.702088:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00100000:2.0:1783141935.702100:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+5:2399:x1869759501155072:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:2.0:1783141935.702142:0:11334:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806db0 00000100:00080000:2.0:1783141935.702160:0:11334:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783141935.702198:0:11334:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1783141935.702375:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141935.702390:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51a41658-4bb5-47ac-acec-f543eb9c9e19+3:2399:x1869759501155072:12345-192.168.203.39@tcp:39:umount.0 Request processed in 293us (1444us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783141935.702578:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00080000:3.0:1783141935.709052:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783141936.004691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141936.386863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141936.386902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141936.386935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141936.387020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155456 00000100:00100000:0.0:1783141936.387031:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155456 00000100:00100000:0.0:1783141936.387094:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155328 00000100:00100000:0.0:1783141936.387098:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155328 00000100:00100000:0.0:1783141936.387121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 323 00000100:00100000:0.0:1783141936.387131:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501155456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141936.387215:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2401:x1869759501155456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141936.387222:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 323 00000100:00100000:0.0:1783141936.387238:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 324 00000100:00100000:0.0:1783141936.387245:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2401:x1869759501155328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783141936.387303:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2401:x1869759501155328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141936.387323:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 324 00000100:00080000:2.0:1783141936.387499:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141936.387504:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783141936.387730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155200 00000100:00100000:3.0:1783141936.387735:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155200 00000100:00100000:3.0:1783141936.387786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 388 00000100:00100000:3.0:1783141936.387794:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2401:x1869759501155200:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783141936.387826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2401:x1869759501155200:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141936.387833:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 388 00000100:00100000:0.0:1783141936.390544:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521113728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783141936.390618:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.394319:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113728 00000100:00100000:3.0:1783141936.394335:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113728 00000100:00100000:3.0:1783141936.394634:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783141936.394647:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521113728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783141936.394686:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783141936.399744:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521113728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5091us (9116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141936.399758:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783141936.399910:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521113728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783141936.900786:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521114240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141936.900853:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.900914:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141936.900920:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521113856:0@lo:400:kworker.0 00000100:00100000:3.0:1783141936.900949:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.900980:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114240 00000100:00100000:3.0:1783141936.900987:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114240 00000100:00100000:3.0:1783141936.901033:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141936.901055:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521114240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141936.901084:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783141936.901125:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521114240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141936.901146:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141936.901193:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521114240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141936.901223:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521114112:0@lo:400:kworker.0 00000100:00100000:3.0:1783141936.901250:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.901293:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141936.901377:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521113984:0@lo:400:kworker.0 00000100:00100000:3.0:1783141936.901405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.901433:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114112 00000100:00100000:3.0:1783141936.901437:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114112 00000100:00100000:3.0:1783141936.901459:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783141936.901465:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521114112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141936.901502:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521114112:12345-0@lo:400:kworker.0 Request processed in 36us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141936.901509:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783141936.901532:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521114112:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.901684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113856 00000100:00100000:2.0:1783141936.901688:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113856 00000100:00100000:2.0:1783141936.901724:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783141936.901732:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.901794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3654:x1869759521113856:12345-0@lo:400:kworker.0 Request processed in 63us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141936.901801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783141936.901839:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521113984 00000100:00100000:2.0:1783141936.901842:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521113984 00000100:00100000:2.0:1783141936.901869:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1783141936.901875:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521113984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.901909:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521113984:12345-0@lo:400:kworker.0 Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141936.901916:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1783141936.901942:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521113984:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.901969:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521113856:0@lo:400:kworker.0 00000100:00080000:2.0:1783141936.901984:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141936.902603:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521114496:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.902790:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521115008:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.902834:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783141936.902839:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521114624:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.902872:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521115136:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.902915:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521114368:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902937:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.902964:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521114880:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.902990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.903003:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521115392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141936.903023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141936.903141:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114496 00000100:00100000:1.0:1783141936.903146:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114496 00000100:00100000:1.0:1783141936.903180:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115008 00000100:00100000:1.0:1783141936.903182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115008 00000100:00100000:1.0:1783141936.903196:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114624 00000100:00100000:1.0:1783141936.903198:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114624 00000100:00100000:1.0:1783141936.903209:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115136 00000100:00100000:1.0:1783141936.903212:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115136 00000100:00100000:1.0:1783141936.903222:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114368 00000100:00100000:1.0:1783141936.903224:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114368 00000100:00100000:1.0:1783141936.903238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783141936.903245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.903312:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521114496:12345-0@lo:400:kworker.0 Request processed in 67us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.903319:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783141936.903338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783141936.903344:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521115008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.903371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521115008:12345-0@lo:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.903377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783141936.903388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783141936.903394:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.903419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521114624:12345-0@lo:400:kworker.0 Request processed in 26us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.903433:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783141936.903447:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783141936.903594:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114880 00000100:00100000:0.0:1783141936.903598:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114880 00000100:00100000:0.0:1783141936.903647:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783141936.903653:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521114880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141936.903688:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521114880:12345-0@lo:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141936.903694:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783141936.903712:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115392 00000100:00100000:0.0:1783141936.903715:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115392 00000100:00100000:0.0:1783141936.903738:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783141936.903743:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521115392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783141936.903755:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783141936.903794:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521115392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141936.903800:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783141936.903823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783141936.903830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521114368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141936.903858:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521114368:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141936.903864:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:0.0:1783141936.903920:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141936.903931:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141936.903933:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783141936.903935:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783141936.903968:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f767800 x1869759521114624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141936.903981:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521114624:0@lo:400:kworker.0 00000100:00100000:0.0:1783141936.903992:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521114496:0@lo:400:kworker.0 00000100:00100000:0.0:1783141936.904001:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521115008:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.905144:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783141936.905169:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521114752:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.905232:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.905269:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521115264:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.905301:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141936.905335:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521114368:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.905346:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521114880:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.905363:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521115392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783141936.905460:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.905521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521115136:12345-0@lo:400:kworker.0 Request processed in 2067us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.905529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783141936.905563:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521114752 00000100:00100000:1.0:1783141936.905569:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521114752 00000100:00100000:1.0:1783141936.905608:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115264 00000100:00100000:1.0:1783141936.905611:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115264 00000100:00100000:1.0:1783141936.905630:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783141936.905636:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521114752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.905671:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7cb08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521114752:12345-0@lo:400:kworker.0 Request processed in 35us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.905676:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783141936.905808:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783141936.905815:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521115264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141936.905841:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521115264:12345-0@lo:400:kworker.0 Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141936.905847:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1783141936.905881:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765880 x1869759521115136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141936.905894:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521115136:0@lo:400:kworker.0 00000100:00080000:1.0:1783141936.905912:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141936.907466:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521114752:0@lo:400:kworker.0 00000100:00100000:2.0:1783141936.907484:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521115264:0@lo:400:kworker.0 00010000:00010000:1.0:1783141937.028997:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141937.414761:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783141937.414798:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521115520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783141937.414871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141937.415025:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115520 00000100:00100000:2.0:1783141937.415033:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115520 00000100:00100000:2.0:1783141937.415098:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783141937.415107:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521115520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783141937.415143:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783141937.415192:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521115520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141937.415199:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783141937.416307:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521115520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783141937.505818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141937.505867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783141937.505971:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155584 00000100:00100000:1.0:1783141937.505981:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155584 00000100:00100000:1.0:1783141937.506038:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155712 00000100:00100000:1.0:1783141937.506042:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155712 00000100:00100000:1.0:1783141937.506067:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783141937.506077:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+11:2400:x1869759501155584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141937.506092:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141937.506110:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3600/0xb31399d6a3806eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e539 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141937.506128:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141937.506180:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+10:2400:x1869759501155584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141937.506187:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783141937.506231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:1.0:1783141937.506239:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+9:2400:x1869759501155712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141937.506248:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141937.506257:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a38070a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e5f6 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141937.506266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141937.506328:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:2400:x1869759501155712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141937.506334:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1783141937.509614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141937.509827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156096 00000100:00100000:0.0:1783141937.509837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156096 00000100:00100000:0.0:1783141937.509894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:0.0:1783141937.509903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+6:2399:x1869759501156096:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:0.0:1783141937.509943:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ec1 00000020:00010000:0.0:1783141937.509951:0:6522:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f9b4302c800: total 0 00000100:00080000:0.0:1783141937.509955:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141937.509982:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:3.0:1783141937.510219:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f9b4302c800: total 0 00010000:00010000:3.0:1783141937.510298:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f9b4302c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783141937.510330:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b427bb300) 00010000:00010000:3.0:1783141937.510334:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141937.510343:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b4407e000/0xb31399d6a3807e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9d1 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141937.510369:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f9b4302c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783141937.510382:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141937.510397:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141937.510399:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141937.510740:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37e420ea-50f1-4924-a953-18d6b00f4d34+3:2399:x1869759501156096:12345-192.168.203.39@tcp:39:umount.0 Request processed in 837us (1134us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1783141937.510750:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:2.0:1783141937.511214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783141937.511647:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501155840 00000100:00100000:3.0:1783141937.511655:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501155840 00000100:00100000:3.0:1783141937.511709:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783141937.511717:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+8:2402:x1869759501155840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141937.511730:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141937.511744:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cd400/0xb31399d6a3806eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e56a expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141937.511760:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141937.511810:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+7:2402:x1869759501155840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 93us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141937.511818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783141937.518960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783141937.519038:0:11334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156224 00000100:00100000:0.0:1783141937.519048:0:11334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156224 00000100:00100000:0.0:1783141937.519112:0:11334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:0.0:1783141937.519147:0:11334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+5:2399:x1869759501156224:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:0.0:1783141937.519192:0:11334:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ec8 00000100:00080000:0.0:1783141937.519201:0:11334:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141937.519329:0:11334:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783141937.519732:0:11334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:37e420ea-50f1-4924-a953-18d6b00f4d34+3:2399:x1869759501156224:12345-192.168.203.39@tcp:39:umount.0 Request processed in 586us (780us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783141937.519741:0:11334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 261 00010000:00010000:1.0:1783141937.520171:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141937.557903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783141937.558011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156480 00000100:00100000:2.0:1783141937.558021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156480 00000100:00100000:2.0:1783141937.558082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 390 00000100:00100000:2.0:1783141937.558092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+7:2399:x1869759501156480:12345-192.168.203.39@tcp:251:umount.0 00000020:00000080:2.0:1783141937.558146:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d86 00000020:00010000:2.0:1783141937.558154:0:6516:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f9b427f0000: total 0 00000100:00080000:2.0:1783141937.558158:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783141937.558242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c66971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f+3:2399:x1869759501156480:12345-192.168.203.39@tcp:251:umount.0 Request processed in 151us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141937.558249:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 390 00000020:00010000:3.0:1783141937.559008:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f9b427f0000: total 0 00010000:00010000:3.0:1783141937.559016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141937.559081:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f9b427f0000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783141937.559134:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cd800/0xb31399d6a3806e5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e52b expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141937.559155:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f9b427f0000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783141937.559167:0:6511:0:(genops.c:906:class_export_put()) final put ffff9f9b427f0000/81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f 00010000:00010000:3.0:1783141937.559187:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141937.559189:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141937.559191:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783141937.559264:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b427f0000/81b1e1ca-4c2b-4a2d-aca7-c7d961e0a00f for MGS 00000020:00000080:0.0:1783141937.559316:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b427f5800 for MGS 00000100:00100000:0.0:1783141937.928562:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521115648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141937.928639:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141937.928804:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115648 00000100:00100000:3.0:1783141937.928812:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115648 00000100:00100000:3.0:1783141937.928865:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783141937.928888:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521115648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141937.928918:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783141937.928976:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521115648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141937.928982:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783141937.929071:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521115648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783141938.052485:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141938.436466:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521115776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783141938.436534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141938.436650:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115776 00000100:00100000:1.0:1783141938.436659:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115776 00000100:00100000:1.0:1783141938.436717:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783141938.436724:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521115776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783141938.436747:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783141938.436801:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521115776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141938.436808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1783141938.436862:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141938.437146:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521115776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783141939.079226:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783141939.187790:0:15153:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783141939.225644:0:15153:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783141939.225699:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.225725:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.225732:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.225740:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.225765:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783141939.225770:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783141939.225794:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141939.225798:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783141939.225815:0:15153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783141939.225840:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c7b4bc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783141939.226095:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141939.226115:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.226123:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141939.226126:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.226134:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141939.226141:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141939.226147:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783141939.226149:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783141939.226151:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783141939.226178:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.226191:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141939.226221:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.226228:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76345600/0xb31399d6a3806e2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e35 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.226239:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141939.226240:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141939.226242:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141939.226258:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521115904:0@lo:39:umount.0 00000100:00100000:2.0:1783141939.226344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141939.226572:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521116032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141939.226603:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141939.226664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521115904 00000100:00100000:3.0:1783141939.226670:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521115904 00000100:00100000:3.0:1783141939.226721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783141939.226730:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759521115904:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783141939.226764:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a380699d 00000100:00080000:3.0:1783141939.226771:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9f9c7b6be800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783141939.226821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3651:x1869759521115904:12345-0@lo:39:umount.0 Request processed in 92us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.226829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1783141939.226838:0:6523:0:(genops.c:906:class_export_put()) final put ffff9f9c7b6bf800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1783141939.226856:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141939.226879:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b6bf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783141939.226919:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c7b6be800 for lustre-MDT0000 00000100:00100000:2.0:1783141939.227034:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116032 00000100:00100000:2.0:1783141939.227041:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116032 00000100:00100000:2.0:1783141939.227082:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141939.227089:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3655:x1869759521116032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141939.227099:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141939.227227:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40031600/0xb31399d6a3806e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e2e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.227240:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141939.227300:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3655:x1869759521116032:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141939.227307:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1783141939.227341:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7b4bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783141939.227350:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521115904:0@lo:39:umount.0 00000100:00100000:0.0:1783141939.227424:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521116032:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783141939.227446:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141939.227449:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783141939.227453:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783141939.228339:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228351:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228358:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228364:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228383:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141939.228389:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228395:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228401:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228407:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228425:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783141939.228431:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228438:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228444:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228450:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228458:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783141939.228462:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228469:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228475:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228482:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141939.228488:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783141939.228491:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783141939.228521:0:15153:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783141939.228524:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783141939.228528:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141939.228533:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1783141939.228539:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f9b427f6800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783141939.228545:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f9b41b11800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783141939.228549:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f9c74cdb000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783141939.228554:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f9c7c5d0800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1783141939.228561:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9f9b4302c800 37e420ea-50f1-4924-a953-18d6b00f4d34 192.168.203.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783141939.228567:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9f9c7c5d7800 51a41658-4bb5-47ac-acec-f543eb9c9e19 192.168.203.39@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:0.0:1783141939.228571:0:15153:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9f9c6ccdcd40) has exports, disconnecting them 00000020:00080000:0.0:1783141939.228575:0:15153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f9b427f6800), last request at 1783141936 00000020:00000080:0.0:1783141939.228582:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806cad 00000100:00080000:0.0:1783141939.228598:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783141939.228642:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b427f6800): rc 0 00000020:00000080:0.0:1783141939.228644:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9b427f6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783141939.228652:0:15153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f9b41b11800), last request at 1783141936 00000020:00000080:0.0:1783141939.228656:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b87 00000100:00080000:0.0:1783141939.228660:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9b41b10000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783141939.228667:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b41b11800): rc 0 00000020:00000080:0.0:1783141939.228668:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9b41b11800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783141939.228673:0:15153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f9c74cdb000), last request at 1783141722 00000020:00000080:0.0:1783141939.228675:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a84 00000100:00080000:0.0:1783141939.228678:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c74cda800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783141939.228684:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c74cdb000): rc 0 00000020:00000080:0.0:1783141939.228685:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c74cdb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783141939.228697:0:15153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f9c7c5d0800), last request at 1783141722 00000020:00000080:0.0:1783141939.228701:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a45 00000100:00080000:0.0:1783141939.228704:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c74d2e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141939.228711:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:0.0:1783141939.228787:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c7c5d0800): rc 0 00000004:00000080:0.0:1783141939.228793:0:15153:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb174153bae0 00000100:00080000:0.0:1783141939.228809:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783141939.228812:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1783141939.229577:0:15153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783141939.229601:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5a2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783141939.229949:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783141939.229967:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.229977:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141939.229981:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.229991:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141939.229998:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141939.230004:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783141939.230007:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783141939.230010:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783141939.230037:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230043:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141939.230073:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230081:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3a00/0xb31399d6a3806e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230094:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783141939.230205:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230214:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fc00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141939.230222:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230230:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141939.230236:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141939.230242:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783141939.230244:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783141939.230246:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783141939.230261:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230266:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141939.230292:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230298:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fc00/0xb31399d6a3806d40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230309:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141939.230312:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230317:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141939.230320:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230327:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141939.230340:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141939.230345:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783141939.230347:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783141939.230349:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783141939.230363:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230368:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141939.230386:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230393:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76344600/0xb31399d6a3807096 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380709d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230402:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141939.230405:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230411:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141939.230414:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230420:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141939.230426:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141939.230442:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783141939.230445:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783141939.230446:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783141939.230460:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230466:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141939.230472:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230479:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f000/0xb31399d6a38068fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806903 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.230489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141939.230490:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141939.230492:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141939.230509:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521116416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141939.230571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141939.230605:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141939.230611:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521116288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141939.230630:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141939.230653:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521116544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141939.230672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141939.230686:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141939.230690:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521116672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141939.230827:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116416 00000100:00100000:3.0:1783141939.230840:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116416 00000100:00100000:3.0:1783141939.230882:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116288 00000100:00100000:3.0:1783141939.230885:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116288 00000100:00100000:3.0:1783141939.230897:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116544 00000100:00100000:3.0:1783141939.230900:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116544 00000100:00100000:3.0:1783141939.230915:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141939.230924:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+25:3653:x1869759521116416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141939.230937:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141939.230949:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168e800/0xb31399d6a3806d47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806d40 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141939.230962:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141939.236394:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+24:3653:x1869759521116416:12345-0@lo:103:ldlm_bl.0 Request processed in 5462us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.236409:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141939.236445:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783141939.236456:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+23:3653:x1869759521116288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141939.236473:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141939.236492:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424cc800/0xb31399d6a3806e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e3c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141939.236508:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141939.236536:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+22:3653:x1869759521116288:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.236541:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783141939.236553:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783141939.236559:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+21:3654:x1869759521116544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141939.236567:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141939.236589:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76345800/0xb31399d6a380709d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3807096 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141939.236597:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141939.236621:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759521116544:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (5949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.236627:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1783141939.236645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141939.236700:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b427f6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783141939.236750:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41b11800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783141939.236780:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cdb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783141939.236809:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b427f3000 for lustre-MDT0000 00000020:00000080:3.0:1783141939.236813:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b41b10000 for lustre-MDT0000 00000020:00000080:3.0:1783141939.236817:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c74cda800 for lustre-MDT0000 00000100:00100000:3.0:1783141939.236837:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116160:0@lo:39:umount.0 00000100:00100000:3.0:1783141939.236877:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141939.236954:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521116288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141939.236965:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3653:1869759521116416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141939.236995:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116160 00000100:00100000:3.0:1783141939.237000:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116160 00000100:00100000:3.0:1783141939.237031:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783141939.237037:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759521116160:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783141939.237060:0:6527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806af4 00000100:00080000:3.0:1783141939.237067:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9f9c76002800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141939.237085:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1783141939.237220:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3651:x1869759521116160:12345-0@lo:39:umount.0 Request processed in 182us (342us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783141939.237237:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1783141939.237265:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783141939.237299:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116160:0@lo:39:umount.0 00010000:00010000:3.0:1783141939.237323:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141939.238410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141939.238451:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116672 00000100:00100000:2.0:1783141939.238467:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116672 00000100:00100000:2.0:1783141939.238509:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141939.238516:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4bf7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+20:3654:x1869759521116672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141939.238527:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141939.238543:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c82157a00/0xb31399d6a3806903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a38068fc expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141939.238560:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141939.238594:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4bf7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fff34e-7fb2-485e-92da-c3efe35c6ff5+19:3654:x1869759521116672:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141939.238601:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141939.238672:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521116672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141939.238682:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521116544:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783141939.240836:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783141939.240845:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1783141939.240864:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783141939.240923:0:15153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783141939.240945:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c6f70f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783141939.240965:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783141939.240968:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1783141939.240979:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783141939.241049:0:15153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783141939.241058:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783141939.241084:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f9c6ccdcd40) has no exports 00000100:00100000:0.0:1783141939.241590:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116800:0@lo:9:umount.0 00000100:00100000:0.0:1783141939.241653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141939.241688:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116928:0@lo:9:umount.0 00000100:00100000:0.0:1783141939.241721:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141939.241810:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116800 00000100:00100000:3.0:1783141939.241818:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116800 00000100:00100000:3.0:1783141939.241874:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521116928 00000100:00100000:3.0:1783141939.241878:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521116928 00000100:00100000:3.0:1783141939.241898:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783141939.241907:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759521116800:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783141939.241931:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806c2f 00000100:00080000:3.0:1783141939.241939:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9c6f70e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141939.241977:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783141939.242093:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3651:x1869759521116800:12345-0@lo:9:umount.0 Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.242101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783141939.242133:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783141939.242140:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1869759521116928:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783141939.242151:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d7f 00000100:00080000:3.0:1783141939.242156:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141939.242177:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783141939.242244:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3651:x1869759521116928:12345-0@lo:9:umount.0 Request processed in 105us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141939.242250:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1783141939.242267:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141939.242299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783141939.243008:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141939.243014:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141939.243051:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c6f70f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783141939.243072:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783141939.243074:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141939.243079:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116800:0@lo:9:umount.0 00000100:00080000:0.0:1783141939.243092:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783141939.243101:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783141939.243115:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141939.243118:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521116928:0@lo:9:umount.0 00000020:00080000:2.0:1783141939.253419:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f9c6ccdcd40) has no exports 00000020:00000080:2.0:1783141939.309258:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806957 00000020:00000080:2.0:1783141939.310948:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c44211800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783141939.311017:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783141939.312328:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c44211800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783141939.312482:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141939.312492:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783141939.312497:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9f9c4b3c0000) has no exports 00000020:00000080:3.0:1783141939.315775:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806950 00000020:00000080:3.0:1783141939.315786:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c7b499000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783141939.315858:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141939.315868:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783141939.315871:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c7b49a800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783141939.315875:0:15153:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b49a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783141939.315880:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783141939.315902:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b499000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1783141940.112206:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141940.932928:0:13803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1783141940.998844:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783141940.998852:0:6501:0:(genops.c:906:class_export_put()) final put ffff9f9c7c5d0800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783141940.998871:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00080000:1.0:1783141940.998881:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1783141940.998884:0:6501:0:(genops.c:906:class_export_put()) final put ffff9f9b4302c800/37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00100000:1.0:1783141940.998889:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000001:00080000:1.0:1783141940.998893:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1783141940.998909:0:6501:0:(genops.c:906:class_export_put()) final put ffff9f9c7c5d7800/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:2.0:1783141940.998937:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7c5d0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783141940.999003:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4302c800/37e420ea-50f1-4924-a953-18d6b00f4d34 for lustre-MDT0000 00000020:00000080:2.0:1783141940.999028:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7c5d7800/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-MDT0000 00000020:00000080:2.0:1783141940.999066:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c74d2e000 for lustre-MDT0000 00000020:00000080:2.0:1783141940.999072:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4302b800 for lustre-MDT0000 00000020:00000080:2.0:1783141940.999076:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b435e1000 for lustre-MDT0000 00010000:00010000:3.0:1783141941.125396:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783141941.317483:0:15153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b4218e120 - data ffff9f9c6d6cf510/ffff9f9b41a45c00 00000020:01000000:3.0:1783141941.317691:0:15153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9c48f486c0 - data ffff9f9c6d58c000/ffff9f9c7491d400 00000001:00000004:3.0:1783141941.324711:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1783141941.378067:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783141941.378077:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1783141941.378093:0:15153:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f9b441e3100 x1869759521116160/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783141949 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141941.378132:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783141941.381998:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783141941.382006:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1783141941.382054:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141941.382057:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783141941.382373:0:8860:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783141941.382378:0:8860:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1783141941.382388:0:8860:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783141941.382915:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783141941.382919:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1783141941.382930:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141941.382932:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783141941.383645:0:9973:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783141941.383649:0:9973:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783141941.383666:0:9973:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1783141941.387513:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a380691f 00000020:00000080:2.0:1783141941.387525:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c4426a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783141941.387986:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141941.390025:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806934 00000020:00000080:2.0:1783141941.390039:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c6cceb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783141941.390190:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783141941.390197:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141941.390204:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783141941.390208:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9f9c6ccdb380) has no exports 00000004:01000000:2.0:1783141941.390388:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783141941.390397:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d6a 00000020:00000080:2.0:1783141941.390401:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9b435e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.390978:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6cceb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783141941.391534:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783141941.391542:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141941.391553:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783141941.391556:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9f9b432bb380) has no exports 00000020:00000080:2.0:1783141941.391563:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d63 00000020:00000080:2.0:1783141941.391569:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9b435e5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783141941.391636:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b435e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1783141941.392164:0:15153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783141941.392169:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783141941.392173:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1783141941.392178:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141941.392180:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141941.392615:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b435e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141941.392789:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141941.392802:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783141941.392810:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806c28 00000020:00000080:2.0:1783141941.392816:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c6f709800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.392841:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b435e4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783141941.392847:0:36:0:(genops.c:906:class_export_put()) final put ffff9f9b432c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.392849:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b432c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783141941.392854:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783141941.393385:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783141941.393392:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141941.393400:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783141941.393404:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9f9b423019c0) has no exports 00000020:00000080:2.0:1783141941.393411:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806c21 00000020:00000080:2.0:1783141941.393415:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c6f709000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783141941.393763:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6f709800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783141941.393772:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6f709000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783141941.394586:0:15153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783141941.394592:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783141941.394595:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1783141941.394601:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141941.394603:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783141941.394684:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141941.394694:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783141941.394708:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783141941.394713:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806aed 00000020:00000080:2.0:1783141941.394719:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c74cde000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.394797:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c6f70f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783141941.394803:0:36:0:(genops.c:906:class_export_put()) final put ffff9f9c760a4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.394805:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c760a4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783141941.394811:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783141941.394986:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783141941.394991:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141941.394996:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783141941.394999:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9f9c7b663380) has no exports 00000020:00000080:2.0:1783141941.395004:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ae6 00000020:00000080:2.0:1783141941.395007:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c74cd8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783141941.395022:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cde000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783141941.395961:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cd8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783141941.402342:0:15153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783141941.402352:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783141941.402356:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1783141941.402363:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141941.402433:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.402446:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141941.402472:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.402476:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141941.402481:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c4426d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141941.402485:0:15153:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783141941.402491:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141941.402591:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a380693b 00000020:00000080:1.0:1783141941.402599:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c6ccee000/lustre-MDD0000_UUID 00000020:01000000:1.0:1783141941.402604:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783141941.402607:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141941.402642:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c7c5a2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783141941.402650:0:36:0:(genops.c:906:class_export_put()) final put ffff9f9c74cd8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783141941.402659:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cd8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783141941.402665:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141941.402716:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141941.402720:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9f9c6ccd8000) has no exports 00000020:00000080:1.0:1783141941.402747:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.402752:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783141941.402756:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806942 00000020:00000080:1.0:1783141941.402760:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c6cce8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783141941.402776:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c4bd6c000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783141941.402779:0:15153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c4bd6c000 3 00000020:01000004:1.0:1783141941.402781:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f9c4bd6c000 from lustre-MDT0000 00000020:00000080:1.0:1783141941.402799:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.402802:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783141941.402805:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c4426b000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783141941.402806:0:15153:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783141941.402813:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783141941.402843:0:15153:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783141941.402846:0:15153:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783141941.402849:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783141941.402851:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141941.402854:0:15153:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141941.402860:0:15153:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9f9c49109800 20fff34e-7fb2-485e-92da-c3efe35c6ff5 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141941.402865:0:15153:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9f9c4b3c4d40) has exports, disconnecting them 00000020:00080000:1.0:1783141941.402876:0:15153:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f9c49109800), last request at 1783141703 00000020:00000080:1.0:1783141941.402890:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38068e0 00000020:00010000:1.0:1783141941.402893:0:15153:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f9c49109800: total 2 00000100:00080000:1.0:1783141941.402897:0:15153:0:(import.c:65:import_set_state_nolock()) ffff9f9c49108800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783141941.402921:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c49109800): rc 0 00000020:00080000:1.0:1783141941.402925:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9f9c4b3c4d40) has no exports 00000020:00000080:0.0:1783141941.402988:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6ccee000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783141941.402992:0:36:0:(genops.c:906:class_export_put()) final put ffff9f9c6cceb000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783141941.402994:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6cceb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783141941.403001:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783141941.403034:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6cce8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1783141941.403142:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f9c79aca800:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1783141941.412673:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f9c4b347600:6516] 1 exiting: rc = 0 00000020:00010000:2.0:1783141941.413340:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f9c49109800: total 0 00010000:00010000:2.0:1783141941.413399:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f9c49109800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783141941.413500:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a3807073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a380706c expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413542:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344200/0xb31399d6a3806e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e12 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413554:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344a00/0xb31399d6a3806e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e20 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413565:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3e00/0xb31399d6a38069dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a38069d5 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413578:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3200/0xb31399d6a38069ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a38069e3 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413591:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344800/0xb31399d6a3807081 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a380707a expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413606:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b424ccc00/0xb31399d6a3806e51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e4a expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413617:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76345c00/0xb31399d6a380708f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3807088 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413629:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c76344400/0xb31399d6a3806def lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806de8 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413640:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c414a2600/0xb31399d6a3806d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806cfa expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc3000/0xb31399d6a3806de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806dda expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413904:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c40030e00/0xb31399d6a3806dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806df6 expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413922:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3806e0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb31399d6a3806e04 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141941.413935:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f9c49109800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783141941.413957:0:6511:0:(genops.c:906:class_export_put()) final put ffff9f9c49109800/20fff34e-7fb2-485e-92da-c3efe35c6ff5 00010000:00010000:2.0:1783141941.413983:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141941.413986:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141941.413988:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783141941.414040:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c49109800/20fff34e-7fb2-485e-92da-c3efe35c6ff5 for MGS 00000020:00000080:0.0:1783141941.414214:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c49108800 for MGS 00000100:00100000:2.0:1783141941.418561:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f9c79aca000:6517] 2 exiting: rc = 0 00000100:00100000:1.0:1783141941.418897:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418907:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418916:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418925:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418934:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418941:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418949:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418955:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418961:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418967:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418973:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418980:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418986:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418991:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.418997:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419016:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419023:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419029:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419035:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419042:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419048:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419053:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419059:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419065:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419071:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419076:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419082:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419087:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419109:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419120:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419130:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419137:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419143:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419149:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419478:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419487:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419494:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419501:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419508:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419515:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419521:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419527:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419533:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419540:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419546:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419553:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419558:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419564:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419572:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419579:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419586:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419592:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419600:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419608:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419614:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419621:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419629:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419635:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419642:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419649:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419657:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419664:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419670:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141941.419834:0:15153:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783141941.421242:0:15153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b420c0900 - data ffff9f9c6d7290d8/ffff9f9b433d3000 00000020:01000000:1.0:1783141941.421382:0:15153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9c66901f60 - data ffff9f9c6d435288/ffff9f9c4902f800 00000020:00000080:1.0:1783141941.422099:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38068c4 00000020:00000080:1.0:1783141941.422108:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c44e57000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783141941.422127:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c4bd6c000 from MGS, refs=2 00000020:01000004:1.0:1783141941.422131:0:15153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c4bd6c000 2 00000020:01000004:1.0:1783141941.422134:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f9c4bd6c000 from MGS 00000020:00000080:1.0:1783141941.422208:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.422216:0:15153:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783141941.422219:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c4bd6e800/MGS 00000020:00000080:1.0:1783141941.422222:0:15153:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4bd6e800/MGS for MGS 00000020:01000000:1.0:1783141941.422229:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783141941.422306:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783141941.422310:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141941.422315:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141941.422321:0:15153:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f9c7b4ba000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141941.422327:0:15153:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9f9c4b3c19c0) has exports, disconnecting them 00000020:00080000:1.0:1783141941.422332:0:15153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f9c7b4ba000), last request at 1783141703 00000020:00000080:1.0:1783141941.422336:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a380698f 00000020:00080000:1.0:1783141941.422345:0:15153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c7b4ba000): rc 0 00000020:00000080:1.0:1783141941.422350:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c7b4ba000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783141941.422691:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c44e57000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783141941.422700:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b4ba000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783141941.475622:0:15153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783141941.475631:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783141941.475636:0:15153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783141941.475643:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141941.475855:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141941.475864:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783141941.475873:0:15153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c4bd6c000 1 00000020:00000080:1.0:1783141941.475878:0:15153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38068b6 00000020:00000080:1.0:1783141941.475886:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c42bf2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783141941.475977:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c7b4bc000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783141941.475985:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9c7b4b9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783141941.475988:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b4b9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783141941.475999:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1783141941.476219:0:15153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783141941.476224:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141941.476229:0:15153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141941.476233:0:15153:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9f9c48c2cd40) has no exports 00000020:00000080:0.0:1783141941.478785:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c42bf2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783141941.549191:0:15153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141941.549214:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783141941.549220:0:15153:0:(genops.c:906:class_export_put()) final put ffff9f9c4bd6a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783141941.549224:0:15153:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4bd6a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783141941.549233:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783141941.549391:0:15153:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f9c4bd6e000 00000020:02000400:3.0:1783141941.549457:0:15153:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1783141942.022684:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521117056:0@lo:400:kworker.0 00000400:00000100:1.0:1783141942.022745:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759521117056 offset 0 length 224: 4 00000100:00100000:1.0:1783141942.022789:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521117568:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.022817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.022836:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521118080:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.022857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.022877:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783141942.022882:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521117184:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.022903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.022919:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521117696:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.022939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.022976:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117568 00000100:00100000:1.0:1783141942.022984:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117568 00000100:00100000:1.0:1783141942.023042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783141942.023052:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521117568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.023106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521117568:12345-0@lo:400:kworker.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141942.023113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783141942.023139:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118080 00000100:00100000:1.0:1783141942.023144:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118080 00000100:00100000:1.0:1783141942.023171:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117696 00000100:00100000:1.0:1783141942.023174:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117696 00000100:00100000:3.0:1783141942.023312:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521117440:0@lo:400:kworker.0 00000100:00100000:3.0:1783141942.023346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141942.023369:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521117952:0@lo:400:kworker.0 00000100:00100000:3.0:1783141942.023392:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141942.023411:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141942.023418:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521117312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141942.023441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141942.023472:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521117824:0@lo:400:kworker.0 00000100:00100000:3.0:1783141942.023495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141942.023519:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117440 00000100:00100000:3.0:1783141942.023523:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117440 00000100:00100000:3.0:1783141942.023539:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117952 00000100:00100000:3.0:1783141942.023541:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117952 00000100:00100000:3.0:1783141942.023554:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117312 00000100:00100000:3.0:1783141942.023556:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117312 00000100:00100000:3.0:1783141942.023565:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117824 00000100:00100000:3.0:1783141942.023568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117824 00000100:00100000:3.0:1783141942.023761:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783141942.023772:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521117952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141942.023819:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521117952:12345-0@lo:400:kworker.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141942.025812:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783141942.025836:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521118080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.025915:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521118080:12345-0@lo:400:kworker.0 Request processed in 84us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141942.025923:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783141942.025943:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783141942.025950:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521117696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.025979:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521117696:12345-0@lo:400:kworker.0 Request processed in 30us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141942.025984:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783141942.026010:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521117184 00000100:00100000:1.0:1783141942.026017:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521117184 00000100:00100000:1.0:1783141942.026047:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783141942.026051:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1869759521117184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783141942.026056:0:6528:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783141942.026079:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1869759521117184:12345-0@lo:400:kworker.0 Request processed in 27us (3175us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783141942.026085:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1783141942.026104:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141942.026108:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141942.026111:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783141942.026831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141942.026838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117440:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783141942.026845:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783141942.026885:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117440:12345-0@lo:400:kworker.0 Request processed in 46us (3538us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783141942.026892:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783141942.026913:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141942.026918:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117312:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783141942.026937:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783141942.026959:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117312:12345-0@lo:400:kworker.0 Request processed in 40us (3517us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783141942.026965:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783141942.026976:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783141942.026981:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117824:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783141942.026985:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783141942.027018:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1869759521117824:12345-0@lo:400:kworker.0 Request processed in 35us (3522us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783141942.027024:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783141942.027249:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521118208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783141942.027300:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141942.027337:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118208 00000100:00100000:2.0:1783141942.027343:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118208 00000100:00100000:2.0:1783141942.027374:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783141942.027381:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521118208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783141942.027404:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783141942.027440:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521118208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141942.027447:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783141942.027488:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521118208:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783141942.031494:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783141942.031502:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c76000000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783141942.031507:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:0.0:1783141942.034917:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783141942.034935:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1783141942.034941:0:7454:0:(genops.c:906:class_export_put()) final put ffff9f9c7c5d7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783141942.034960:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00080000:0.0:1783141942.034966:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1783141942.034968:0:7454:0:(genops.c:906:class_export_put()) final put ffff9f9b4302c000/37e420ea-50f1-4924-a953-18d6b00f4d34 00000001:00100000:0.0:1783141942.034973:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000001:00080000:0.0:1783141942.034978:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1783141942.034980:0:7454:0:(genops.c:906:class_export_put()) final put ffff9f9b435e3800/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:0.0:1783141942.034994:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7c5d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783141942.035071:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4302c000/37e420ea-50f1-4924-a953-18d6b00f4d34 for lustre-MDT0001 00000020:00000080:0.0:1783141942.035095:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b435e3800/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-MDT0001 00000020:00000080:0.0:1783141942.035120:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c76002800 for lustre-MDT0001 00000020:00000080:0.0:1783141942.035125:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4302d800 for lustre-MDT0001 00000020:00000080:0.0:1783141942.035128:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b432c7800 for lustre-MDT0001 00000100:00100000:3.0:1783141942.035197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:1.0:1783141942.037761:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783141942.037768:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5d2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783141942.037772:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783141942.037778:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5d2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783141942.037782:0:3652:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 233 00000100:00080000:1.0:1783141942.037790:0:3652:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f9c7c5d2000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141942.037826:0:3652:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44157100 x1869759521118336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141942.037857:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521117184:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.037879:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521117696:0@lo:400:kworker.0 00010000:00080000:1.0:1783141942.037894:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76308700 x1869759521117568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141942.037905:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521117568:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.037916:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521118080:0@lo:400:kworker.0 00000100:00100000:0.0:1783141942.038119:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521118336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783141942.038180:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.038257:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118336 00000100:00100000:1.0:1783141942.038263:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118336 00000100:00100000:1.0:1783141942.038328:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783141942.038336:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1869759521118336:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783141942.038355:0:7933:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783141942.038396:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1869759521118336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60us (216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783141942.038404:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1783141942.039034:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141942.039041:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783141942.039045:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521118336:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:3.0:1783141942.040188:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783141942.040196:0:9517:0:(genops.c:906:class_export_put()) final put ffff9f9b435e0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783141942.040217:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:3.0:1783141942.040220:0:9517:0:(genops.c:906:class_export_put()) final put ffff9f9c4a2f4000/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:1.0:1783141942.040336:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b435e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783141942.040384:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4a2f4000/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-OST0001 00000020:00000080:1.0:1783141942.040399:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b435e1800 for lustre-OST0001 00000020:00000080:1.0:1783141942.040403:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c4a2f5000 for lustre-OST0001 00000100:00080000:2.0:1783141942.049872:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c76000000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141942.049884:0:3655:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 233 00000100:00080000:2.0:1783141942.049894:0:3655:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f9c76000000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141942.052419:0:3655:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1880 x1869759521118464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141942.052453:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521117312:0@lo:400:kworker.0 00000100:00080000:0.0:1783141942.052481:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783141942.052485:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783141942.052489:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783141942.052493:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783141942.052496:0:3655:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 274 00000100:00080000:0.0:1783141942.052503:0:3655:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f9b432c5800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141942.052515:0:3655:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e2680 x1869759521118592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141942.052524:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1869759521117824:0@lo:400:kworker.0 00000100:00080000:0.0:1783141942.052536:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783141942.052550:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783141942.052554:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783141942.052556:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783141942.052559:0:3655:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 252 00000100:00080000:0.0:1783141942.052562:0:3655:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f9c760a2800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141942.052575:0:3655:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1500 x1869759521118720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141942.052585:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1869759521117440:0@lo:400:kworker.0 00010000:00080000:0.0:1783141942.052601:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76309c00 x1869759521117952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141942.052611:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521117952:0@lo:400:kworker.0 00000100:00100000:1.0:1783141942.052674:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759521118464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783141942.052743:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.052792:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521118592:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783141942.052824:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.052849:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521118720:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783141942.052867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141942.052912:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118464 00000100:00100000:1.0:1783141942.052918:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118464 00000100:00100000:1.0:1783141942.052948:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118592 00000100:00100000:1.0:1783141942.052951:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118592 00000100:00100000:1.0:1783141942.052964:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118720 00000100:00100000:1.0:1783141942.052967:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118720 00000100:00100000:1.0:1783141942.052981:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783141942.052987:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118464:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783141942.053005:0:7934:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783141942.053046:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118464:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 57us (314us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783141942.053053:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783141942.053072:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783141942.053076:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118592:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783141942.053086:0:7934:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783141942.053110:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118592:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31us (285us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783141942.053115:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783141942.053128:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783141942.053131:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118720:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783141942.053140:0:7934:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783141942.053157:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1869759521118720:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 25us (290us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783141942.053168:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1783141942.053209:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c76000000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141942.053214:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783141942.053217:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759521118464:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783141942.053225:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141942.053228:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783141942.053231:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521118592:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783141942.053238:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141942.053240:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783141942.053243:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521118720:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:2.0:1783141942.054639:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783141942.054645:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9c6f708800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783141942.054659:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:2.0:1783141942.054661:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9b4372d800/51a41658-4bb5-47ac-acec-f543eb9c9e19 00000020:00000080:0.0:1783141942.054845:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c6f708800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783141942.054889:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4372d800/51a41658-4bb5-47ac-acec-f543eb9c9e19 for lustre-OST0000 00000020:00000080:0.0:1783141942.054910:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c6f70e000 for lustre-OST0000 00000020:00000080:0.0:1783141942.054914:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4372c800 for lustre-OST0000 00010000:00010000:2.0:1783141942.151565:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141943.172720:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141943.558086:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521118848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783141943.558156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141943.558262:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118848 00000100:00100000:0.0:1783141943.558287:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118848 00000100:00100000:0.0:1783141943.558339:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783141943.558347:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521118848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783141943.558376:0:11089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783141943.560910:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521118848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2557us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141943.560925:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141943.561021:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521118848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783141944.204320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141944.642962:0:15354:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783141944.652122:0:15354:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1783141944.652180:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.652194:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.652202:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.652225:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.652250:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783141944.652256:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783141944.652297:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783141944.652302:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783141944.652307:0:15354:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783141944.652312:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9c76000000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783141944.652316:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783141944.652318:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783141944.652321:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783141944.654297:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141944.654319:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141944.654330:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141944.654334:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141944.654345:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141944.654353:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141944.654359:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783141944.654361:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783141944.654364:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783141944.654403:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141944.654408:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141944.654442:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141944.654450:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a3806e12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e19 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141944.654463:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141944.654465:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141944.654467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141944.654482:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141944.654499:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521118976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141944.654574:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141944.654637:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521118976 00000100:00100000:0.0:1783141944.654644:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521118976 00000100:00100000:0.0:1783141944.654682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783141944.654689:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3654:x1869759521118976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783141944.654695:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141944 with bad export cookie 12903826504491755744 00010000:00010000:3.0:1783141944.657863:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657880:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657888:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657895:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657919:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783141944.657926:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657950:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657955:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657961:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.657986:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783141944.657994:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658000:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658006:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658011:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658020:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783141944.658025:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658031:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658048:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658054:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.658062:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783141944.658066:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1783141944.658094:0:15354:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1783141944.658098:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1783141944.658102:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141944.658107:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783141944.658113:0:15354:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f9b4302e800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783141944.658119:0:15354:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f9b41a09000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783141944.658123:0:15354:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9f9c74d33380) has exports, disconnecting them 00000020:00080000:3.0:1783141944.658127:0:15354:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f9b4302e800), last request at 1783141942 00000020:00000080:3.0:1783141944.658133:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806cc2 00000100:00080000:3.0:1783141944.658163:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783141944.658209:0:15354:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b4302e800): rc 0 00000020:00000080:3.0:1783141944.658212:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9b4302e800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1783141944.658223:0:15354:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f9b41a09000), last request at 1783141942 00000020:00000080:3.0:1783141944.658227:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b9c 00000100:00080000:3.0:1783141944.658232:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783141944.658237:0:15354:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b41a09000): rc 0 00000020:00000080:3.0:1783141944.658239:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9b41a09000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1783141944.658245:0:15354:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb1741853ae0 00000100:00080000:3.0:1783141944.658263:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783141944.658301:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1783141944.659065:0:15354:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783141944.659071:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9c7c5d2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1783141944.659186:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4302e800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783141944.659230:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41a09000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783141944.659251:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4302a800 for lustre-MDT0001 00000020:00000080:3.0:1783141944.659254:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b41a0f000 for lustre-MDT0001 00010000:00010000:3.0:1783141944.659301:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783141944.659308:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659317:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40030000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141944.659321:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659330:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141944.659338:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141944.659343:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141944.659346:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1783141944.659348:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1783141944.659387:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659392:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141944.659410:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659432:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40030000/0xb31399d6a3806e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806e27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659444:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783141944.659447:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659451:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141944.659454:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659459:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141944.659465:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141944.659469:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141944.659471:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783141944.659473:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783141944.659485:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659490:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141944.659495:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659501:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3806cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a3806d01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659522:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141944.659525:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659531:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344c00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141944.659534:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659541:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141944.659548:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141944.659552:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783141944.659555:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783141944.659556:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783141944.659569:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659575:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141944.659588:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659594:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76344c00/0xb31399d6a3807088 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a380708f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659602:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141944.659605:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659617:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141944.659619:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659626:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141944.659632:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141944.659637:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141944.659639:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783141944.659641:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783141944.659653:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659659:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141944.659665:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659672:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a38069e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb31399d6a38069ea expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141944.659682:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141944.659684:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141944.659685:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141944.660448:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521119488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141944.660514:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141944.660566:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141944.660573:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521119360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141944.660596:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141944.660641:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521119488 00000100:00100000:1.0:1783141944.660647:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521119488 00000100:00100000:1.0:1783141944.660678:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521119360 00000100:00100000:1.0:1783141944.660681:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521119360 00000100:00100000:1.0:1783141944.660696:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141944.660703:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3655:x1869759521119488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783141944.660709:0:10341:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141944 with bad export cookie 12903826504491755744 00000100:00100000:1.0:1783141944.660770:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3655:x1869759521119488:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (255us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783141944.660777:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141944.660804:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141944.660809:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3655:x1869759521119360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783141944.660814:0:10341:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141944 with bad export cookie 12903826504491755744 00000100:00100000:1.0:1783141944.660841:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3655:x1869759521119360:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (245us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783141944.660847:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783141944.660884:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783141944.660888:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783141944.660892:0:3655:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1783141944.661215:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141944.661356:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783141944.661360:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1783141944.661375:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783141944.661443:0:15354:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783141944.661460:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783141944.661474:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783141944.661477:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1783141944.661485:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783141944.661540:0:15354:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783141944.661550:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9f9c7dffc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783141944.661575:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9f9c74d33380) has no exports 00000100:00100000:0.0:1783141944.670331:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3654:x1869759521118976:12345-0@lo:103:ldlm_bl.0 Request processed in 15636us (15752us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783141944.670345:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1783141944.670615:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783141944.683386:0:3655:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.139@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783141944.683392:0:3655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783141944.683402:0:3655:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c7630ad80 x1869759521117056/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783141958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141944.683418:0:3655:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b441e1c00 x1869759521118976/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141960 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141944.683429:0:3655:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b44235500 x1869759521119488/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141960 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141944.683441:0:3655:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b44234e00 x1869759521119360/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141960 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783141944.683450:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783141944.683453:0:3655:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783141944.683454:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783141944.683507:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:0:1869759521119104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141944.683530:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3652:1869759521117056:0@lo:400:kworker.0 00000100:00100000:3.0:1783141944.683840:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20fff34e-7fb2-485e-92da-c3efe35c6ff5:0:1869759521119232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141944.684063:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521119616:0@lo:9:umount.0 00000100:00100000:3.0:1783141944.684267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783141944.685188:0:3654:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f9c669f1000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1783141944.685211:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3654:1869759521118976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141944.685398:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521119744:0@lo:9:umount.0 00000100:00100000:3.0:1783141944.685440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141944.685509:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521119616 00000100:00100000:0.0:1783141944.685519:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521119616 00000100:00100000:0.0:1783141944.685579:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521119744 00000100:00100000:0.0:1783141944.685582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521119744 00000100:00100000:0.0:1783141944.685607:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783141944.685617:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759521119616:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783141944.685656:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806be9 00000100:00080000:0.0:1783141944.685666:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9f9c74cd9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141944.685711:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1783141944.685836:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783141944.685848:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1869759521119744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783141944.685865:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d2b 00000100:00080000:2.0:1783141944.685872:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783141944.685875:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3651:x1869759521119616:12345-0@lo:9:umount.0 Request processed in 258us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141944.685885:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000001:00000004:2.0:1783141944.685904:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1783141944.685906:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783141944.685934:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783141944.685946:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783141944.685961:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141944.685966:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521119616:0@lo:9:umount.0 00000100:00100000:2.0:1783141944.686027:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3651:x1869759521119744:12345-0@lo:9:umount.0 Request processed in 181us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141944.686034:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1783141944.686051:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783141944.686095:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c7dffc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783141944.686112:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783141944.686114:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141944.686117:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521119744:0@lo:9:umount.0 00000100:00080000:2.0:1783141944.686328:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141944.686332:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141944.688317:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783141944.688328:0:3655:0:(import.c:512:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 214 00000100:00080000:1.0:1783141944.688338:0:3655:0:(import.c:626:import_select_connection()) MGC192.168.203.139@tcp: import ffff9f9c669f1000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141944.688436:0:3655:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44157100 x1869759521119872/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141944.688486:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521119872:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1783141944.688530:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759521119872 offset 0 length 520: 4 00000100:00100000:1.0:1783141944.688591:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521119488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141944.688608:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3655:1869759521119360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783141944.700838:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9f9c74d33380) has no exports 00000020:01000000:0.0:1783141944.764021:0:15354:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b4218ea80 - data ffff9f9c6d629e58/ffff9f9b41a46400 00000020:01000000:0.0:1783141944.764403:0:15354:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9c7c5bb120 - data ffff9f9c6d62aca8/ffff9f9c7c60ac00 00000001:00000004:2.0:1783141944.774697:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1783141944.825101:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141944.825110:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1783141944.825117:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783141944.828947:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783141944.828954:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1783141944.828975:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141944.828977:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783141944.829660:0:8850:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783141944.829665:0:8850:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1783141944.829675:0:8850:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1783141944.830183:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783141944.830187:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1783141944.830205:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783141944.830207:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783141944.830661:0:9967:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783141944.830664:0:9967:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1783141944.830673:0:9967:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783141944.832064:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a06 00000020:00000080:3.0:1783141944.832076:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c74d2e800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783141944.832336:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74d2e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783141944.834490:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a1b 00000020:00000080:3.0:1783141944.834501:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c44269000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783141944.834509:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1783141944.834513:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141944.834520:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783141944.834524:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9f9c4b3c3380) has no exports 00000020:00000080:2.0:1783141944.834612:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c44269000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1783141944.834693:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783141944.834702:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d24 00000020:00000080:3.0:1783141944.834707:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9b427f7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783141944.834733:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783141944.834737:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141944.834746:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783141944.834749:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9f9b42304d40) has no exports 00000020:00000080:3.0:1783141944.834760:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806d1d 00000020:00000080:3.0:1783141944.834765:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c760a3000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783141944.834924:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b427f7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783141944.834931:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c760a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783141944.835886:0:15354:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783141944.835891:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783141944.835895:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1783141944.835899:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783141944.836084:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783141944.836135:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141944.836145:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783141944.836170:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806be2 00000020:00000080:3.0:1783141944.836178:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9b41b15000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783141944.836184:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783141944.836189:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141944.836194:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783141944.836196:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9f9c74d319c0) has no exports 00000020:00000080:3.0:1783141944.836201:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806bdb 00000020:00000080:3.0:1783141944.836205:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9b41a08800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783141944.836343:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c7dffc800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783141944.836351:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9b42641800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141944.836354:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b42641800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1783141944.836360:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141944.836453:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41b15000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1783141944.836460:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41a08800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783141944.836613:0:15354:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783141944.836617:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783141944.836620:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1783141944.836625:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783141944.836627:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783141944.836668:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141944.836674:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1783141944.836685:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783141944.836687:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b41a0d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783141944.836691:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a3e 00000020:00000080:2.0:1783141944.836696:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9b41a0d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783141944.836698:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c74cd9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141944.836700:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41a0d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1783141944.836706:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1783141944.836729:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1783141944.836734:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141944.836738:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783141944.836741:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9f9c48c2b380) has no exports 00000020:00000080:3.0:1783141944.836746:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a37 00000020:00000080:3.0:1783141944.836757:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c44211000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783141944.836802:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cd9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1783141944.836811:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c44211000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783141944.839321:0:15354:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1783141944.839334:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141944.839337:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783141944.839345:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783141944.839417:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c7c5d2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1783141944.839453:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141944.839463:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141944.839469:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c44268000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141944.839472:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c44268000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1783141944.839486:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141944.839735:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141944.839740:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141944.839743:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c74d2d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141944.839745:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74d2d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1783141944.839758:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783141944.839857:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a22 00000020:00000080:2.0:1783141944.839864:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c4426d800/lustre-MDD0001_UUID 00000020:01000000:2.0:1783141944.840020:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1783141944.840025:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141944.840031:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783141944.840034:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9f9c74d34d40) has no exports 00000020:00000080:2.0:1783141944.840062:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141944.840068:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1783141944.840073:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a29 00000020:00000080:2.0:1783141944.840077:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c4426f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783141944.840224:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1783141944.840229:0:36:0:(genops.c:906:class_export_put()) final put ffff9f9c74d2a800/lustre-MDD0001_UUID 00000020:00000080:0.0:1783141944.840232:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74d2a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1783141944.840236:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:2.0:1783141944.840623:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c7b4fc000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1783141944.840627:0:15354:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b4fc000 2 00000020:01000004:2.0:1783141944.840631:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f9c7b4fc000 from lustre-MDT0001 00000020:00000080:2.0:1783141944.840651:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783141944.840680:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783141944.840704:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1783141944.840708:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c74d2a000/lustre-MDT0001_UUID 00000020:00000080:2.0:1783141944.840710:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74d2a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1783141944.840725:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1783141944.840757:0:15354:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1783141944.840760:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1783141944.840763:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141944.840767:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783141944.840773:0:15354:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f9c76001800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783141944.840779:0:15354:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9f9c74d30000) has exports, disconnecting them 00000020:00080000:2.0:1783141944.840783:0:15354:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f9c76001800), last request at 1783141722 00000020:00000080:2.0:1783141944.840787:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806a7d 00000020:00080000:2.0:1783141944.840798:0:15354:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c76001800): rc 0 00000020:00000080:2.0:1783141944.840802:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c76001800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1783141944.844215:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c76001800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1783141944.846063:0:15354:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1783141944.846071:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141944.846075:0:15354:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783141944.846092:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783141944.846119:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c76000000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1783141944.846262:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783141944.846289:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1783141944.846294:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c7b6b8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1783141944.846298:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b6b8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1783141944.846312:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1783141944.846385:0:15354:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b4fc000 1 00000020:00000080:0.0:1783141944.846391:0:15354:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38069b9 00000020:00000080:0.0:1783141944.846397:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c669f5000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1783141944.846404:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1783141944.846412:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c669f5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1783141944.846420:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141944.846425:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783141944.846428:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9f9c7b6619c0) has no exports 00000020:00000080:0.0:1783141944.880028:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783141944.880042:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1783141944.880047:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c7b4f9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783141944.880052:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b4f9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1783141944.880064:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1783141944.880378:0:15354:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f9c7b4fc800 00000020:01000000:0.0:1783141944.880401:0:15354:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783141944.880405:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141944.880409:0:15354:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783141944.880413:0:15354:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9f9c48c299c0) has no exports 00000100:00100000:1.0:1783141944.880736:0:11334:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9f9b4279d200:11334] 4 exiting: rc = 0 00000100:00100000:2.0:1783141944.880743:0:7934:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f9c7b6ae800:7934] 3 exiting: rc = 0 00000100:00100000:0.0:1783141944.880822:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f9c709b9800:6524] 2 exiting: rc = 0 00000100:00100000:3.0:1783141944.880882:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f9c4b315400:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1783141944.881068:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f9c45376e00:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1783141944.881239:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881250:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881255:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881261:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881266:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881622:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881701:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881707:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881721:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881726:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881731:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881736:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881741:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881745:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881750:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881755:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881760:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881765:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881770:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881775:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881780:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881784:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881789:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881794:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881799:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881803:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881808:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881812:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881818:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881823:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881828:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881833:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881839:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881844:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881874:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881880:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881885:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881890:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881895:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881933:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881945:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881950:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881954:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881959:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881965:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881971:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881976:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881981:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881986:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881991:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.881997:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882003:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882009:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882015:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882021:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882026:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882032:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882037:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882042:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882048:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882053:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882059:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882064:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.882078:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.886818:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f9c45376a00:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1783141944.886937:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f9c709b8400:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1783141944.887462:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887594:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887603:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887609:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887613:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887618:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887623:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887632:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887637:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887642:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887647:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887652:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887657:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887662:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887666:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887671:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887675:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887680:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887684:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887688:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887692:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887697:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887701:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887708:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887721:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887726:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887730:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887735:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887739:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887743:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887747:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887752:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887756:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887760:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887764:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887769:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887779:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887784:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887789:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887793:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887797:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887802:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887807:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887811:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887815:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887819:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887824:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887828:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887833:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887837:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887842:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887847:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887851:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887855:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887860:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887865:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887869:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887874:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887882:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887950:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887957:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887962:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887968:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.887973:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.889014:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f9c709b9e00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1783141944.889170:0:7933:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9f9c7c5b6c00:7933] 2 exiting: rc = 0 00000100:00100000:0.0:1783141944.889319:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f9c66930a00:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1783141944.889404:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889413:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889419:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889424:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889429:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889435:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889441:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889447:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889452:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889457:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889463:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889469:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889654:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889662:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889682:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889688:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889693:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889697:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889702:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889708:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889721:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889727:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889733:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889739:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889744:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889751:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889768:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889774:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889779:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889792:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889798:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889803:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889809:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889814:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889820:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889826:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889832:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889838:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889860:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889868:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889873:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889879:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889885:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889890:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889895:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889901:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889906:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889912:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889918:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889923:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889941:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889948:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889954:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889959:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889965:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889971:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889977:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889984:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889990:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.889996:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.890002:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.890007:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.890015:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.890029:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.898417:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f9c66930c00:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1783141944.898598:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f9c66931800:6530] 1 exiting: rc = 0 00000100:00100000:3.0:1783141944.900032:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900040:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900045:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900051:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900056:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900061:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900066:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900072:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900077:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900082:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900087:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900091:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900096:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900101:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900107:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900112:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900117:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900122:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900127:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900131:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900136:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900140:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900144:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900149:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900154:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900158:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900226:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900231:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900236:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900241:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900245:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900250:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900254:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900259:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900263:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900402:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900408:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900412:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900417:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900422:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900427:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900432:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900438:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900443:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900447:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900452:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900456:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900466:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900471:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900586:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900593:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900598:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900602:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900606:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900611:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900615:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900621:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900626:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900679:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900684:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900688:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900693:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.900697:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.901135:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f9c6173b400:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1783141944.901389:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f9c58312800:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1783141944.904326:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904337:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904341:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904346:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904351:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904357:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904379:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904384:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904389:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904394:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904399:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904404:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904409:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904414:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904418:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904422:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904427:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904431:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904436:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904441:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904445:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904460:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904465:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904470:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904707:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904726:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904731:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904736:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904742:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904746:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904750:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904755:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904760:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904766:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904770:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904774:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904779:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904783:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904787:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904798:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904803:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904808:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904813:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904818:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904823:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904827:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904832:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904836:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904840:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904845:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904849:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904853:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904858:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904862:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904867:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904871:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904875:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904879:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904883:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904887:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904891:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.904895:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141944.905737:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f9c616bf400:6534] 1 exiting: rc = 0 00000100:00100000:2.0:1783141944.905903:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f9c616bea00:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1783141944.905973:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.905980:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.905986:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.905992:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.905997:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906002:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906008:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906013:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906018:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906024:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906029:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906033:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906047:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906053:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906058:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906064:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906069:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906074:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906079:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906084:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906090:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906094:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906100:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906105:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906110:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906116:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906121:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906126:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906131:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906136:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906141:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906148:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906152:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906157:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906226:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906232:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906236:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906241:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906247:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906253:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906258:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906263:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906268:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906362:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906367:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906377:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906389:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906394:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906399:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906404:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906408:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906414:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906419:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906424:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906429:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906434:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906439:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906445:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906449:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906454:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906459:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906464:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.906469:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141944.907295:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f9c616bf200:6535] 0 exiting: rc = 1 00000100:00100000:3.0:1783141944.907596:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f9c616bf000:6537] 2 exiting: rc = 0 00000100:00100000:0.0:1783141944.907847:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f9c616be600:6536] 1 exiting: rc = 0 00000100:00100000:3.0:1783141944.907957:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907963:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907968:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907975:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907980:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907985:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907990:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.907996:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908001:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908007:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908013:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908019:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908024:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908029:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908035:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908056:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908063:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908078:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908083:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908089:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908094:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908099:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908105:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908110:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908115:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908120:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908125:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908131:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908136:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908141:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908147:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908152:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908157:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908225:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908231:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908235:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908240:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908245:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908250:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908269:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908353:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908359:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908364:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908369:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908374:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908379:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908385:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908390:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908395:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908401:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908406:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908411:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908424:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908429:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908434:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908440:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908445:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908460:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908465:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908471:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908594:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141944.908609:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783141944.912759:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141944.912772:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1783141944.912777:0:15354:0:(genops.c:906:class_export_put()) final put ffff9f9c669f7000/MDS_uuid 00000020:00000080:3.0:1783141944.912833:0:15354:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c669f7000/MDS_uuid for MDS 00000020:01000000:3.0:1783141944.912840:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1783141944.912988:0:15354:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1783141945.221588:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141946.244450:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141947.140808:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141947.140816:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783141947.140833:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141947.140837:0:14636:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783141947.140841:0:14636:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141947.140848:0:14636:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1783141947.140854:0:14636:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783141947.140861:0:14636:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f9c760a2800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141947.140895:0:14636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80df80 x1869759521120000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141947.140953:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141947.140956:0:14636:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783141947.140958:0:14636:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141947.140961:0:14636:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1783141947.140964:0:14636:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783141947.140967:0:14636:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f9b432c5800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141947.140978:0:14636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80f480 x1869759521120256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141947.141061:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521120128:0@lo:400:kworker.0 00000400:00000100:0.0:1783141947.141115:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120128 offset 0 length 224: 4 00000100:00100000:0.0:1783141947.141176:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141947.141183:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521120384:0@lo:400:kworker.0 00000400:00000100:0.0:1783141947.141200:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120384 offset 0 length 224: 4 00000100:00100000:1.0:1783141947.141772:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521120000:0@lo:38:kworker.0 00000400:00000100:1.0:1783141947.141800:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120000 offset 0 length 520: 4 00000100:00100000:1.0:1783141947.141824:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521120256:0@lo:38:kworker.0 00000400:00000100:1.0:1783141947.141840:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120256 offset 0 length 520: 4 00010000:00010000:3.0:1783141947.270033:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141948.060130:0:15554:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783141948.073449:0:15554:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783141948.073503:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.073531:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.073538:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.073545:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.073570:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783141948.073587:0:15554:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783141948.073612:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783141948.073623:0:15554:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80df80 x1869759521120000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783141962 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141948.073640:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783141948.073646:0:15554:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783141948.073652:0:15554:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783141948.073657:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783141948.073661:0:15554:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80df80 x1869759521120000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783141962 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141948.073667:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783141948.073671:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1783141948.074245:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141948.074254:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.074263:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141948.074268:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.074308:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141948.074329:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141948.074335:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783141948.074343:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783141948.074345:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783141948.074367:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:2.0:1783141948.074371:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.074378:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a3806df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806dfd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.074390:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141948.074392:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141948.074393:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141948.077146:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521120000:0@lo:38:kworker.0 00000100:00080000:3.0:1783141948.078087:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783141948.078100:0:15554:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80dc00 x1869759521120128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141948.078113:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783141948.078119:0:15554:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783141948.078139:0:15554:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783141948.078209:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759521120512:0@lo:39:umount.0 00000400:00000100:1.0:1783141948.078256:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120512 offset 0 length 224: 4 00000100:00100000:0.0:1783141948.078309:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521120128:0@lo:400:kworker.0 00010000:00010000:3.0:1783141948.292483:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141949.188545:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141949.188555:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783141949.188559:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141949.188562:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783141949.188738:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521120640:0@lo:400:kworker.0 00000400:00000100:0.0:1783141949.188790:0:3654:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120640 offset 0 length 224: 4 00010000:00010000:2.0:1783141949.316982:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141950.340944:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783141950.727903:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141950.727912:0:8433:0:(genops.c:906:class_export_put()) final put ffff9f9c7b4fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783141950.728478:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b4fb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783141950.728529:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c74cd9000 for lustre-OST0000 00000001:00100000:0.0:1783141950.728640:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783141950.728645:0:9517:0:(genops.c:906:class_export_put()) final put ffff9f9b432c2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783141950.728707:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b432c2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783141950.728740:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b432c1800 for lustre-OST0001 00010000:00010000:2.0:1783141951.364482:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141952.196437:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141952.196448:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141952.196452:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141952.196455:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783141952.196626:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521120768:0@lo:400:kworker.0 00000400:00000100:1.0:1783141952.196691:0:3655:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521120768 offset 0 length 224: 4 00010000:00010000:3.0:1783141952.388813:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141953.414315:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141954.244419:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141944/real 1783141944] req@ffff9f9b44157100 x1869759521119872/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783141954 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141954.244454:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b44157100 x1869759521119872/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783141954 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141954.244476:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783141954.244508:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783141954.244512:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521119872:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1783141954.244610:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141954.244616:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783141954.244618:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783141954.244622:0:36:0:(import.c:512:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1783141954.244627:0:36:0:(import.c:591:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783141954.244633:0:36:0:(import.c:626:import_select_connection()) MGC192.168.203.139@tcp: import ffff9f9c669f1000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783141954.244675:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b442cad80 x1869759521120896/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783141954.244706:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141954.244710:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783141954.244835:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521120896:0@lo:250:kworker.0 00000400:00000100:2.0:1783141954.244894:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759521120896 offset 0 length 520: 4 00000100:00100000:0.0:1783141954.244905:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521121024:0@lo:400:kworker.0 00000400:00000100:0.0:1783141954.244930:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521121024 offset 0 length 224: 4 00010000:00010000:3.0:1783141954.438999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141955.462310:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141956.484710:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141957.510378:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141958.340438:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141948/real 1783141948] req@ffff9f9b442c8000 x1869759521120512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783141958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141958.340473:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b442c8000 x1869759521120512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783141958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141958.340493:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783141958.340517:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759521120512:0@lo:39:umount.0 00000100:00080000:3.0:1783141958.340783:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783141958.340788:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783141958.340793:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783141958.341666:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341681:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341688:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341696:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341744:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783141958.341752:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341759:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341764:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341770:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141958.341787:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783141958.341791:0:15554:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1783141958.341862:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141958.341870:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341878:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141958.341882:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341891:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141958.341897:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141958.341903:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783141958.341912:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783141958.341914:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783141958.341927:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:0.0:1783141958.341931:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341939:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76345a00/0xb31399d6a3806e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806e0b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341953:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141958.341956:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341961:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:0.0:1783141958.341964:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341970:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141958.341975:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141958.341980:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783141958.341981:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783141958.341983:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783141958.341987:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:0.0:1783141958.341990:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.341996:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1000/0xb31399d6a380707a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3807081 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141958.342011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141958.342013:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141958.342014:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141958.342113:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141958.342148:0:15554:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783141958.342153:0:15554:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783141958.342158:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141958.342164:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783141958.342169:0:15554:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9f9b41b1b380) has no exports 00000020:00080000:3.0:1783141958.342193:0:15554:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9f9b41b1b380) has no exports 00000020:01000000:3.0:1783141958.345937:0:15554:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b4218e000 - data ffff9f9c6d723ca8/ffff9f9c7631f400 00000020:01000000:3.0:1783141958.346098:0:15554:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b422eec00 - data ffff9f9c6d67d870/ffff9f9b42310c00 00100000:10000000:3.0:1783141958.359172:0:15554:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783141958.371804:0:15554:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b56 00000020:00000080:2.0:1783141958.371819:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9b41b14000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783141958.371877:0:15554:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c7b728800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783141958.371882:0:15554:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b728800 2 00000020:01000004:2.0:1783141958.371885:0:15554:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f9c7b728800 from lustre-OST0000 00000020:00000080:2.0:1783141958.371914:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141958.371927:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783141958.371943:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9b41b14800/lustre-OST0000_UUID 00000020:00000080:2.0:1783141958.371947:0:15554:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41b14800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783141958.371954:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783141958.372033:0:15554:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783141958.372038:0:15554:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783141958.372041:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141958.372046:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783141958.372054:0:15554:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f9c760a4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783141958.372061:0:15554:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9f9c6ccd99c0) has exports, disconnecting them 00000020:00080000:2.0:1783141958.372067:0:15554:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f9c760a4000), last request at 1783141741 00000020:00000080:2.0:1783141958.372072:0:15554:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b80 00000020:00080000:2.0:1783141958.372091:0:15554:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c760a4000): rc 0 00000020:00000080:2.0:1783141958.372100:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9c760a4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783141958.372236:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b41b14000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783141958.375524:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c760a4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783141958.386367:0:15554:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783141958.386381:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141958.386387:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783141958.386397:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783141958.386590:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783141958.386601:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783141958.386609:0:15554:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783141958.386615:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141958.386630:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783141958.386640:0:15554:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f9c760a5800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783141958.386648:0:15554:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9f9b42300000) has exports, disconnecting them 00000020:00080000:0.0:1783141958.386653:0:15554:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f9c760a5800), last request at 1783141741 00000020:00000080:0.0:1783141958.386658:0:15554:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b95 00000020:00080000:0.0:1783141958.386678:0:15554:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9c760a5800): rc 0 00000020:00000080:0.0:1783141958.386686:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9c760a5800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783141958.387598:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c760a2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783141958.387611:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9c7610d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783141958.387626:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7610d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783141958.387642:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783141958.387736:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c760a5800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783141958.387768:0:15554:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783141958.387804:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783141958.387808:0:15554:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783141958.387813:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141958.387835:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c760a1000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783141958.387967:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141958.387975:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783141958.387979:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9c760a2000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783141958.387982:0:15554:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c760a2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783141958.387986:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783141958.388012:0:15554:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c7b728800 1 00000020:00000080:1.0:1783141958.388019:0:15554:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806b1e 00000020:00000080:1.0:1783141958.388024:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9c74cdd800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783141958.388032:0:15554:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783141958.388040:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cdd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783141958.388050:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141958.388055:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783141958.388058:0:15554:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9f9c7b664d40) has no exports 00000020:00000080:1.0:1783141958.421415:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141958.421437:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783141958.421444:0:15554:0:(genops.c:906:class_export_put()) final put ffff9f9c7b72d000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783141958.421455:0:15554:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7b72d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783141958.421474:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783141958.421813:0:15554:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f9c7b728000 00000020:02000400:1.0:1783141958.421937:0:15554:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1783141958.533405:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141959.428357:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141959.428368:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141959.428370:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783141959.428384:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783141959.428650:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141959.428671:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521121152:0@lo:400:kworker.0 00000400:00000100:0.0:1783141959.428733:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521121152 offset 0 length 224: 4 00010000:00010000:2.0:1783141959.556496:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141960.583260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141961.604936:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141961.885185:0:15756:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783141961.907672:0:15756:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783141961.907753:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141961.907767:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141961.907787:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141961.907794:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141961.907819:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783141961.907824:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783141961.907909:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783141961.907920:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80f480 x1869759521120256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783141962 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.907937:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783141961.907966:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141961.907978:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1783141961.907983:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521120256:0@lo:38:kworker.0 00000100:00080000:1.0:1783141961.908008:0:15756:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783141961.908013:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9f9b432c5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783141961.908017:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783141961.908019:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783141961.908021:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783141961.908479:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141961.908487:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141961.908496:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76345000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141961.908500:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141961.908509:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141961.908515:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141961.908521:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141961.908523:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783141961.908525:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783141961.908537:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:3.0:1783141961.908540:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141961.908546:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76345000/0xb31399d6a3806dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806de1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141961.908556:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141961.908558:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141961.908559:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783141961.908635:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783141961.908639:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783141961.908708:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141961.908724:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521121280:0@lo:400:kworker.0 00000400:00000100:0.0:1783141961.908771:0:3655:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521121280 offset 0 length 224: 4 00000100:00080000:1.0:1783141961.911192:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783141961.911208:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80c380 x1869759521120384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911229:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9c6f80ca80 x1869759521120640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141965 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911242:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b442cb100 x1869759521120768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141968 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911267:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b442ca300 x1869759521121024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141970 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911298:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b442c9180 x1869759521121152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911307:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b441e0700 x1869759521121280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141961.911315:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783141961.911321:0:15756:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783141961.911342:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783141961.912521:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521121152:0@lo:400:kworker.0 00000100:00100000:0.0:1783141961.912606:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521120640:0@lo:400:kworker.0 00000100:00100000:1.0:1783141961.912653:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521121408:0@lo:39:umount.0 00000100:00100000:2.0:1783141961.913350:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521121280:0@lo:400:kworker.0 00000100:00100000:3.0:1783141961.913856:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521121024:0@lo:400:kworker.0 00000100:00100000:3.0:1783141961.913865:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521120384:0@lo:400:kworker.0 00000400:00000100:1.0:1783141961.915748:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759521121408 offset 0 length 224: 4 00000100:00100000:2.0:1783141961.916159:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521120768:0@lo:400:kworker.0 00010000:00010000:2.0:1783141962.628541:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141963.652630:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141964.676807:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141965.700999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141966.724501:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783141967.108390:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783141967.108398:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783141967.748561:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141968.772693:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141969.095013:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141954/real 1783141954] req@ffff9f9b442cad80 x1869759521120896/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783141969 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141969.095043:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b442cad80 x1869759521120896/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783141969 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141969.095061:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783141969.095086:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783141969.095107:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521120896:0@lo:250:kworker.0 00000100:00080000:0.0:1783141969.095195:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783141969.095200:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783141969.095202:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783141969.095207:0:36:0:(import.c:512:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1783141969.095211:0:36:0:(import.c:591:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783141969.095218:0:36:0:(import.c:626:import_select_connection()) MGC192.168.203.139@tcp: import ffff9f9c669f1000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141969.095244:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e0000 x1869759521121536/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141969.095343:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521121536:0@lo:250:kworker.0 00000400:00000100:2.0:1783141969.095396:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759521121536 offset 0 length 520: 4 00010000:00010000:3.0:1783141969.799367:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141970.820480:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141971.140939:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141961/real 1783141961] req@ffff9f9b44157100 x1869759521121408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783141971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141971.140972:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b44157100 x1869759521121408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783141971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141971.140991:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4302d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783141971.141016:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521121408:0@lo:39:umount.0 00000100:00080000:0.0:1783141971.141209:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783141971.141213:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783141971.141219:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783141971.147822:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.147839:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.147846:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.147870:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.148038:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141971.148057:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.148065:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.148071:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141971.148076:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148176:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141971.148183:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148190:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c40031000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141971.148195:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148203:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141971.148210:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141971.148216:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141971.148219:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1783141971.148229:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:3.0:1783141971.148233:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148240:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c40031000/0xb31399d6a3806de8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806def expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148266:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141971.148269:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148322:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c76344000 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783141971.148326:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148333:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141971.148339:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141971.148344:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783141971.148346:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783141971.148351:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:3.0:1783141971.148354:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141971.148361:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141971.148363:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141971.148365:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141971.148540:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783141971.148545:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76344000/0xb31399d6a380706c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3807073 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141971.148557:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783141971.148562:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1783141971.148564:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783141971.148589:0:15756:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783141971.148593:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783141971.148598:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141971.148603:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783141971.148607:0:15756:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9f9b43013380) has no exports 00000020:00080000:0.0:1783141971.148630:0:15756:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9f9b43013380) has no exports 00010000:00010000:2.0:1783141971.149967:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783141971.151099:0:15756:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b4218e180 - data ffff9f9b41cc5798/ffff9f9c7631e400 00000020:01000000:0.0:1783141971.151466:0:15756:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f9b4218e480 - data ffff9f9b41c71bd0/ffff9f9b43020400 00100000:10000000:0.0:1783141971.164986:0:15756:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783141971.179032:0:15756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806c7c 00000020:00000080:1.0:1783141971.179043:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9b4302b000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783141971.179063:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6f70d800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783141971.179066:0:15756:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6f70d800 2 00000020:01000004:1.0:1783141971.179070:0:15756:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f9c6f70d800 from lustre-OST0001 00000020:00000080:1.0:1783141971.179094:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141971.179104:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783141971.179107:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9c7dff9000/lustre-OST0001_UUID 00000020:00000080:1.0:1783141971.179109:0:15756:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7dff9000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783141971.179116:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783141971.179227:0:15756:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 20fff34e-7fb2-485e-92da-c3efe35c6ff5->MGS 00010000:00010000:1.0:1783141971.179240:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c82156000/0xb31399d6a38069d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141971.179251:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c82156000/0xb31399d6a38069d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141971.179301:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783141971.179304:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783141971.179307:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783141971.179322:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:1.0:1783141971.179326:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c82156000/0xb31399d6a38069d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a38069dc expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141971.179342:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141971.179350:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141971.179355:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141971.179357:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783141971.179358:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783141971.179367:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f9c669f1000 00010000:00010000:1.0:1783141971.179370:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c76344e00/0xb31399d6a3806e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb31399d6a3806e51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783141971.179386:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9f9c669f1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783141971.179390:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783141971.179392:0:15756:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783141971.179393:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783141971.179397:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783141971.179407:0:15756:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f9b441e0000 x1869759521121536/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783141989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783141971.179424:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783141971.179427:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:3.0:1783141971.179496:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4302b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1783141971.179549:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20fff34e-7fb2-485e-92da-c3efe35c6ff5:3651:1869759521121536:0@lo:250:kworker.0 10000000:01000000:1.0:1783141971.179821:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783141971.179836:0:15756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a38068d2 00000020:00000080:1.0:1783141971.179841:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9c669f3800/20fff34e-7fb2-485e-92da-c3efe35c6ff5 00000020:01000000:1.0:1783141971.179856:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.139@tcp (flags='') 00000020:00000080:1.0:1783141971.179861:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141971.179866:0:15756:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783141971.179869:0:15756:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9f9c48c28000) has no exports 00000020:00000080:3.0:1783141971.179927:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c669f3800/20fff34e-7fb2-485e-92da-c3efe35c6ff5 for MGC192.168.203.139@tcp 10000000:01000000:3.0:1783141971.179953:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783141971.180127:0:15756:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.139@tcp: client import never connected 00000100:00080000:1.0:1783141971.180131:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783141971.180133:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783141971.180135:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783141971.180136:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783141971.180241:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141971.180247:0:15756:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.139@tcp (uuid 20fff34e-7fb2-485e-92da-c3efe35c6ff5) 00000020:01000000:1.0:1783141971.180254:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783141971.180258:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141971.180262:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141971.180267:0:15756:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f9b42643800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141971.180303:0:15756:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9f9b432b99c0) has exports, disconnecting them 00000020:00080000:1.0:1783141971.180308:0:15756:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f9b42643800), last request at 1783141763 00000020:00000080:1.0:1783141971.180312:0:15756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806ca6 00000020:00080000:1.0:1783141971.180323:0:15756:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b42643800): rc 0 00000020:00000080:1.0:1783141971.180327:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9b42643800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783141971.180991:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9c669f1000 for MGC192.168.203.139@tcp 00000020:00000080:3.0:1783141971.181009:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9c669f6000/20fff34e-7fb2-485e-92da-c3efe35c6ff5 00000020:00000080:3.0:1783141971.181012:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c669f6000/20fff34e-7fb2-485e-92da-c3efe35c6ff5 for MGC192.168.203.139@tcp 00000020:01000000:3.0:1783141971.181017:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.139@tcp (20fff34e-7fb2-485e-92da-c3efe35c6ff5) 00000020:00000080:3.0:1783141971.181307:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b42643800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783141971.190054:0:15756:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783141971.190063:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141971.190068:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783141971.190074:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783141971.190260:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141971.190296:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783141971.190304:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783141971.190312:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141971.190317:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783141971.190326:0:15756:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f9b4302f800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783141971.190333:0:15756:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9f9b43014d40) has exports, disconnecting them 00000020:00080000:2.0:1783141971.190338:0:15756:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f9b4302f800), last request at 1783141763 00000020:00000080:2.0:1783141971.190342:0:15756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806cbb 00000020:00080000:2.0:1783141971.190356:0:15756:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f9b4302f800): rc 0 00000020:00000080:2.0:1783141971.190374:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9b4302f800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783141971.191147:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b432c5800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783141971.191157:0:14636:0:(genops.c:906:class_export_put()) final put ffff9f9c7c5d5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783141971.191160:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7c5d5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783141971.191167:0:14636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783141971.191233:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b4302f800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1783141971.191261:0:15756:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783141971.191265:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783141971.191268:0:15756:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783141971.191292:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783141971.191313:0:14636:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f9b4302d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1783141971.191352:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783141971.191452:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1783141971.191568:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f9c4bf47200:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1783141971.191649:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f9c4bf46000:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1783141971.191723:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.191957:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f9c4bf46e00:6508] 1 exiting: rc = 0 00000100:00100000:3.0:1783141971.192020:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f9c79ac3a00:6509] 2 exiting: rc = 0 00000100:00100000:3.0:1783141971.192080:0:9526:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f9c7cb48400:9526] 3 exiting: rc = 0 00000100:00100000:3.0:1783141971.192142:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f9c6692fc00:6507] 0 exiting: rc = 1 00000100:00100000:1.0:1783141971.193143:0:10341:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9f9c7b702a00:10341] 4 exiting: rc = 0 00000100:00100000:3.0:1783141971.193606:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193706:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193716:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193726:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193742:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193757:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193763:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193769:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193774:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193779:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193784:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193790:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193796:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193802:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193808:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193820:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193826:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193831:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193837:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193843:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193848:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193853:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193858:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193863:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193868:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193874:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193889:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193895:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193900:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193905:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193911:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193916:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193921:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193925:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193929:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193934:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193939:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193945:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193950:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193956:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193968:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193984:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193990:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.193995:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194000:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194008:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194014:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194020:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194027:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194033:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194039:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194044:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194049:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194054:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194059:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194064:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194069:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194074:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194079:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194084:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194090:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194095:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194103:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.194111:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783141971.195501:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141971.195511:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783141971.195516:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9b43029000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783141971.195521:0:15756:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9b43029000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783141971.195535:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783141971.195593:0:15756:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6f70d800 1 00000020:00000080:3.0:1783141971.195600:0:15756:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb31399d6a3806c4b 00000020:00000080:3.0:1783141971.195605:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9c7dfff800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783141971.195619:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783141971.195631:0:14636:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c7dfff800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783141971.195651:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141971.195657:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783141971.195660:0:15756:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9f9b42303380) has no exports 00000020:00000080:3.0:1783141971.264659:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141971.264673:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1783141971.264679:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9c4426c800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1783141971.264684:0:15756:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c4426c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1783141971.264690:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1783141971.266178:0:15756:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f9c6f708000 00000020:01000000:3.0:1783141971.266200:0:15756:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1783141971.266204:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141971.266210:0:15756:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783141971.266214:0:15756:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9f9c7b660000) has no exports 00000020:00000080:3.0:1783141971.266247:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141971.266255:0:15756:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1783141971.266258:0:15756:0:(genops.c:906:class_export_put()) final put ffff9f9c74cdc000/OSS_uuid 00000020:00000080:3.0:1783141971.266261:0:15756:0:(genops.c:865:class_export_destroy()) destroying export ffff9f9c74cdc000/OSS_uuid for OSS 00000020:01000000:3.0:1783141971.266266:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1783141971.266385:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f9c61727200:8440] 2 exiting: rc = 0 00000100:00080000:1.0:1783141971.266685:0:6518:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783141971.266796:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f9c7c90bc00:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1783141971.267137:0:8865:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f9c61730c00:8865] 3 exiting: rc = 0 00000100:00100000:1.0:1783141971.267156:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f9c7c90b800:8438] 0 exiting: rc = 1 00000100:00100000:3.0:1783141971.267237:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267246:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267253:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267260:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267294:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267306:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267316:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267323:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267334:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267339:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267344:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267349:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267355:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267363:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267378:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267383:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267390:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267396:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267404:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267415:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267421:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267426:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267432:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267437:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267442:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267448:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267453:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267458:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267464:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267470:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267475:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267480:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267484:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267489:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267495:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267500:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267505:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267511:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267517:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267523:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267540:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267546:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267551:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267556:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267562:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267568:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267573:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267577:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267582:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267594:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267600:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267605:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267611:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267616:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267622:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267627:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267633:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267637:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267642:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267646:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267652:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267657:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267663:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141971.267668:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.270469:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f9c79ac2800:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1783141971.271041:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f9c61727800:8441] 0 exiting: rc = 1 00000100:00100000:2.0:1783141971.271130:0:11089:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f9c76378c00:11089] 2 exiting: rc = 0 00000100:00100000:2.0:1783141971.271199:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271213:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271221:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271227:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271232:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271237:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271242:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271248:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271253:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271258:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271263:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271268:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271314:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271322:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271329:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271337:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271345:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271353:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271361:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271366:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271370:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271391:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271409:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271418:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271429:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271453:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271463:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271474:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271485:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271520:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271551:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271565:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271578:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271589:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271609:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271621:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271648:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271660:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271670:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271679:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271688:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271696:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271703:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271709:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271718:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271729:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271740:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271760:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271769:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271774:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271778:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271784:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271789:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271794:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271799:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271804:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271809:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271814:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271818:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271824:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271829:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271834:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271838:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.271843:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.273834:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f9c7c90b000:8445] 2 exiting: rc = 0 00000100:00100000:2.0:1783141971.275339:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f9c7c90a400:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1783141971.275508:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f9c79ac3800:8443] 0 exiting: rc = 1 00000100:00100000:1.0:1783141971.275852:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.275863:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.275869:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.275875:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276328:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276339:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276345:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276352:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276359:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276366:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276374:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276382:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276391:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276398:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276404:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276410:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276415:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276421:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276428:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276433:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276438:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276443:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276449:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276455:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276460:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276482:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276489:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276495:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276501:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276507:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276512:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276518:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276523:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276539:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276545:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276550:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276556:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276563:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276569:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276582:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276589:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276597:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276601:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276604:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276608:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276613:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276616:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276620:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276623:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276638:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276641:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276645:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276648:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276651:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276655:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276659:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276662:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276670:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276674:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276677:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276681:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276689:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276693:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141971.276702:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.289980:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f9c7c90a200:8447] 1 exiting: rc = 0 00000100:00100000:0.0:1783141971.290091:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f9c7c90b200:8446] 0 exiting: rc = 1 00000100:00100000:0.0:1783141971.290176:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290183:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290188:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290192:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290196:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290201:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290205:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290209:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290213:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290218:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290222:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290227:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290231:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290236:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290240:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290261:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290267:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290296:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290301:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290306:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290310:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290315:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290319:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290324:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290328:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290332:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290338:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290353:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290358:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290362:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290367:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290373:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290378:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290383:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290387:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290392:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290397:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290401:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290406:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290411:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290415:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290420:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290424:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290428:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290433:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290438:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290443:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290448:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290452:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290456:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290462:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290469:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290474:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.290480:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291739:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291754:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291764:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291775:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291782:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291787:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291792:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291797:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291812:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141971.291823:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.296840:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f9c7c90aa00:8448] 0 exiting: rc = 1 00000100:00100000:1.0:1783141971.297347:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f9c7c90be00:8449] 1 exiting: rc = 0 00000100:00100000:2.0:1783141971.297590:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297599:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297604:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297610:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297639:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297645:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297650:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297656:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297664:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297670:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297676:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297682:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297687:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297693:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297698:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297759:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297782:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297789:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297796:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297802:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297808:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297814:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297821:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297827:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297834:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297842:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297847:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297853:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297874:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297881:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.297886:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298114:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298122:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298128:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298150:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298155:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298161:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298167:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298173:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298180:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298203:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298210:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298216:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298221:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298227:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298234:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298240:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298245:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298252:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298258:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298265:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298299:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298322:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298330:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298335:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298341:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298347:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298352:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298358:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298363:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298968:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298976:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298981:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141971.298989:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1783141971.310196:0:15756:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1783141987.291631:0:16522:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783141995.113081:0:17121:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783141995.113086:0:17121:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783141995.113088:0:17121:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783141995.113194:0:17121:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9c6f7af000 00000020:01000004:2.0:1783141995.113209:0:17121:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783141995.113215:0:17121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783141995.113234:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f9b41b1b380) 00000020:00000080:2.0:1783141995.113246:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783141995.168394:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.170593:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783141995.172997:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.173188:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.173743:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.174121:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.174409:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.174813:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.175016:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.175248:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.175552:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783141995.176087:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.176426:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.176656:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.177506:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.177716:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.178050:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.178253:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.178577:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.178791:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.179163:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.179413:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.179593:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.180143:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.180458:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.180695:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.180999:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.181194:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.181532:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.181761:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.182220:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.182506:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.184497:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.184780:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.187739:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.188048:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.188317:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.188579:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.188822:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.189074:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.189302:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.189541:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.189766:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783141995.190021:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.190210:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.190497:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783141995.195720:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.196372:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.196788:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.197173:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.197670:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.198338:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783141995.198586:0:17121:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1783141995.201409:0:17121:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783141995.201640:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783141995.201648:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783141995.202102:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807e8f 00000020:01000004:3.0:1783141995.202111:0:17121:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783141995.202117:0:17121:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783141995.202121:0:17121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c6f7af000 from MGS 00000020:01000004:3.0:1783141995.202125:0:17121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783141995.202186:0:17121:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f9b42303380) 00000020:00000080:3.0:1783141995.202199:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783141995.202262:0:17121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f7af000 from MGS, refs=2 00080000:01000000:3.0:1783141995.202267:0:17121:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783141995.202314:0:17121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807e9d 00000100:00100000:3.0:1783141995.202433:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783141995.202638:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783141995.202644:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783141995.208692:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783141995.208818:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783141995.215562:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141995.215750:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783141995.215757:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783141995.216265:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783141995.216386:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783141995.219636:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783141995.219650:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783141995.220412:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.220416:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.220418:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.220776:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.220778:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.220780:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141995.221580:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783141995.224530:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783141995.233393:0:17121:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783141995.234999:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783141995.235056:0:17121:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783141995.235093:0:17121:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783141995.239538:0:17121:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783141995.240145:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141995.240332:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783141995.240339:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783141995.242937:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783141995.242948:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783141995.243397:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783141995.243404:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783141995.244259:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783141995.244311:0:17121:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.139@tcp' 00000020:01000004:3.0:1783141995.244313:0:17121:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783141995.244341:0:17121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.139@tcp (typ=mgc) 00000020:00000080:3.0:1783141995.244352:0:17121:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.139@tcp (ffff9f9b42300000) 00000020:00000080:3.0:1783141995.244376:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783141995.244457:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c76005800@MGC192.168.203.139@tcp: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783141995.244593:0:17121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.139@tcp-0 is initialized 00000040:01000000:3.0:1783141995.244598:0:17121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783141995.246665:0:17138:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783141995.249483:0:17140:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783141995.251029:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.139@tcp (uuid b0f07033-43f3-43e4-aeca-29a1a105dcc2) 00000020:00000080:2.0:1783141995.251053:0:17121:0:(genops.c:1406:class_connect()) connect: client b0f07033-43f3-43e4-aeca-29a1a105dcc2, cookie 0xb31399d6a3807eab 00000100:00080000:2.0:1783141995.251066:0:17121:0:(import.c:512:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141995.251072:0:17121:0:(import.c:626:import_select_connection()) MGC192.168.203.139@tcp: import ffff9f9c76005800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783141995.251103:0:17121:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80ea00 x1869759521121664/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141995.251131:0:17121:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import b0f07033-43f3-43e4-aeca-29a1a105dcc2->MGS 00000100:00100000:3.0:1783141995.251156:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3651:1869759521121664:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1783141995.251157:0:17121:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783141995.251162:0:17121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783141995.251174:0:17121:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f9b41b1cd40) 00000020:00000080:2.0:1783141995.251184:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783141995.251220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.254933:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521121664 00000100:00100000:0.0:1783141995.254945:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521121664 00000100:00100000:0.0:1783141995.254990:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141995.254998:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3651:x1869759521121664:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783141995.255083:0:17135:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b0f07033-43f3-43e4-aeca-29a1a105dcc2@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1783141995.255112:0:17135:0:(genops.c:1406:class_connect()) connect: client b0f07033-43f3-43e4-aeca-29a1a105dcc2, cookie 0xb31399d6a3807eb9 00000100:00080000:0.0:1783141995.255239:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9f9c48e63800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141995.255339:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:3651:x1869759521121664:12345-0@lo:250:mount.lustre.0 Request processed in 340us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.255348:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141995.255462:0:3651:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783141995.255472:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 00000100:00080000:3.0:1783141995.255481:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783141995.255486:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783141995.255489:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c76005800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783141995.255491:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783141995.255571:0:3651:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783141995.255580:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3651:1869759521121664:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783141995.262267:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141995.262579:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783141995.262585:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783141995.263396:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783141995.263404:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783141995.263933:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783141995.263940:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783141995.265147:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141995.265500:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783141995.265504:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783141995.265972:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783141995.265984:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783141995.308898:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141995.309080:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783141995.309097:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783141995.312898:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783141995.312912:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783141995.316783:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141995.317167:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141995.317173:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783141995.319644:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783141995.319728:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783141995.320877:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141995.321050:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783141995.321055:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783141995.321826:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783141995.321834:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783141995.322419:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141995.322561:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141995.322565:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783141995.323137:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141995.323144:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783141995.345875:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141995.346233:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783141995.346240:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783141995.349650:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783141995.349668:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783141995.354103:0:17121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141995.354124:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783141995.356006:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783141995.356034:0:17121:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783141995.356040:0:17121:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783141995.356128:0:17121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783141995.356158:0:17121:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783141995.356162:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783141995.356164:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141995.356165:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141995.356166:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141995.356168:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141995.356169:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141995.356170:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141995.356172:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141995.356173:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141995.356175:0:17121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141995.356177:0:17121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783141995.356179:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141995.356180:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141995.356182:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141995.356183:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141995.356184:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141995.356185:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141995.356190:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141995.356191:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141995.356192:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141995.356192:0:17121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141995.356219:0:17121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783141995.357185:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521121792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783141995.357311:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.357390:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b678600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.357605:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521121792 00000100:00100000:0.0:1783141995.357613:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521121792 00000100:00100000:0.0:1783141995.357683:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141995.357693:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:17121:x1869759521121792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783141995.357746:0:17137:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783141995.357753:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783141995.357756:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1783141995.359059:0:17158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783141995.360803:0:17137:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1783141995.362820:0:17159:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783141995.362828:0:17159:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783141995.362831:0:17159:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783141995.362833:0:17159:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783141995.363095:0:17159:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783141995.364258:0:17137:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783141995.365603:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783141995.367479:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:17121:x1869759521121792:12345-0@lo:253:mount.lustre.0 Request processed in 9780us (10161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141995.367500:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141995.367557:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521121792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783141995.367573:0:17121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783141995.367576:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141995.367577:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783141995.367579:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141995.367580:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141995.367581:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141995.367582:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141995.367584:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783141995.367585:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783141995.367587:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141995.367588:0:17121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783141995.367607:0:17121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c6f7af000 from lustre-MDT0000 10000000:01000000:0.0:1783141995.367646:0:17121:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783141995.367649:0:17121:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783141995.367653:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f9b42300000 10000000:01000000:0.0:1783141995.367659:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141995.367667:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f9b42300000 from 1 10000000:01000000:0.0:1783141995.367670:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783141995.367711:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.367723:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.367733:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141995.367752:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521121920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783141995.367785:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.367826:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141995.367941:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521121920 00000100:00100000:2.0:1783141995.367948:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521121920 00000100:00100000:2.0:1783141995.367991:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141995.367999:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:17121:x1869759521121920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141995.368012:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141995.368025:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0600/0xb31399d6a3807ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807ec0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.368046:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0600/0xb31399d6a3807ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807ec0 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.368056:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0600/0xb31399d6a3807ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807ec0 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.368065:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0600, rc 0) 00000100:00100000:2.0:1783141995.368105:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+6:17121:x1869759521121920:12345-0@lo:101:mount.lustre.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.368110:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141995.368218:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521121920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141995.368230:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.368239:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141995.368513:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141995.368542:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.368567:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b678480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141995.368639:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122048 00000100:00100000:1.0:1783141995.368644:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122048 00000100:00100000:1.0:1783141995.368879:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141995.368888:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+6:17121:x1869759521122048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141995.369022:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+6:17121:x1869759521122048:12345-0@lo:501:mount.lustre.0 Request processed in 133us (476us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141995.369030:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141995.369088:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122048:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783141995.369117:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783141995.369164:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369173:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141995.369195:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c6f7af000 10000000:01000000:3.0:1783141995.369199:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783141995.369203:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f9c6f7af000 10000000:01000000:3.0:1783141995.369205:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783141995.369208:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f9c6f7af000 from 1 10000000:01000000:3.0:1783141995.369210:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783141995.369232:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369238:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369247:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141995.369260:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141995.369307:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.369330:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b678480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.369427:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122176 00000100:00100000:0.0:1783141995.369432:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122176 00000100:00100000:0.0:1783141995.369464:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141995.369471:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+6:17121:x1869759521122176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141995.369480:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141995.369492:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407e800/0xb31399d6a3807ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807ece expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.369509:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407e800/0xb31399d6a3807ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807ece expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.369518:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407e800/0xb31399d6a3807ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807ece expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.369526:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e800, rc 0) 00000100:00100000:0.0:1783141995.369565:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+7:17121:x1869759521122176:12345-0@lo:101:mount.lustre.0 Request processed in 93us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.369570:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141995.369626:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141995.369648:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ed5 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369657:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807ed5 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141995.369668:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783141995.369687:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ed5 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369702:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2200/0xb31399d6a3807ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ed5 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141995.369707:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783141995.369710:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141995.369714:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f9c6f7af000 10000000:01000000:3.0:1783141995.369717:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783141995.369719:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783141995.369721:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141995.369735:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369742:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.369750:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141995.369761:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141995.369786:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.369817:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b678480 going to sleep for 11 seconds 00000100:00100000:2.0:1783141995.370182:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122304 00000100:00100000:2.0:1783141995.370194:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122304 00000100:00100000:2.0:1783141995.370227:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141995.370234:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+7:17121:x1869759521122304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141995.371214:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141995.371235:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1a00/0xb31399d6a3807ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807edc expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.371266:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1a00/0xb31399d6a3807ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807edc expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.371603:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1a00/0xb31399d6a3807ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807edc expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.371611:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1a00, rc 0) 00000100:00100000:3.0:1783141995.371952:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+8:17121:x1869759521122304:12345-0@lo:101:mount.lustre.0 Request processed in 1716us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141995.371961:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141995.372046:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141995.372065:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ee3 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.372074:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807ee3 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141995.372144:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141995.372175:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.372216:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141995.372292:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122432 00000100:00100000:2.0:1783141995.372307:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122432 00000100:00100000:2.0:1783141995.372505:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141995.372515:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+8:17121:x1869759521122432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141995.372670:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17121:x1869759521122432:12345-0@lo:501:mount.lustre.0 Request processed in 156us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.372677:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141995.372747:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141995.372777:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141995.372832:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.373549:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7b678780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.374007:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122560 00000100:00100000:0.0:1783141995.374015:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122560 00000100:00100000:0.0:1783141995.374051:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141995.374058:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17121:x1869759521122560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141995.375031:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17121:x1869759521122560:12345-0@lo:503:mount.lustre.0 Request processed in 970us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.375040:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141995.375245:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521122560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141995.375915:0:17160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17160:1869759521122688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.375971:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.376024:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122688 00000100:00100000:0.0:1783141995.376030:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122688 00000100:00100000:1.0:1783141995.376033:0:17160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.376062:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783141995.376070:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17160:x1869759521122688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141995.376933:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17160:x1869759521122688:12345-0@lo:502:llog_process_th.0 Request processed in 861us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.376942:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141995.376962:0:17160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17160:1869759521122688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141995.376987:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141995.376997:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.377000:0:17160:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783141995.377005:0:17160:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783141995.377008:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141995.377019:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f9b432bb380) 00000020:00000080:1.0:1783141995.377030:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783141995.377034:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783141995.377089:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783141995.377094:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807ef1 00000020:00000080:1.0:1783141995.377234:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783141995.377236:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141995.377238:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.377240:0:17160:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783141995.377242:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141995.377245:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.377247:0:17160:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783141995.377250:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141995.377265:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f9b432bcd40) 00000020:00000080:1.0:1783141995.377403:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783141995.377410:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783141995.377412:0:17160:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783141995.377415:0:17160:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783141995.377422:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783141995.377479:0:17160:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f7af000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783141995.377501:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f9b432b8000) 00000020:00000080:1.0:1783141995.377511:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783141995.377560:0:17160:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783141995.377565:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3807f06 00000020:00000080:1.0:1783141995.377627:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783141995.377632:0:17160:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783141995.377636:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb31399d6a3807f0d 00080000:01000000:1.0:1783141995.377640:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783141995.377643:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807f14 00010000:00010000:3.0:1783141995.447430:0:17160:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783141995.447873:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1783141995.448483:0:17160:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783141995.448906:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f9b42304d40) 00000020:00000080:3.0:1783141995.448923:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783141995.450265:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783141995.450304:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807f22 00000020:00000080:0.0:1783141995.451798:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783141995.459600:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb31399d6a3807f29 00000020:00000080:0.0:1783141995.459923:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783141995.459936:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.459941:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.459943:0:17160:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783141995.459945:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783141995.459948:0:17160:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783141995.459949:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141995.459950:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141995.459951:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783141995.459952:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.459953:0:17160:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783141995.459955:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.459958:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.459959:0:17160:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783141995.459967:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783141995.459993:0:17160:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783141995.460003:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.460004:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.460005:0:17160:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783141995.460093:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.460096:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.460097:0:17160:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783141995.460099:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141995.460103:0:17160:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:0.0:1783141995.460180:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141995.460196:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f9b43010000) 00000020:00000080:0.0:1783141995.460209:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783141995.460213:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141995.461111:0:17160:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783141995.461128:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783141995.461138:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807f37 00010000:00080000:0.0:1783141995.461172:0:17160:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b4414e000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141995.465053:0:17160:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1783141995.468638:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141995.468654:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783141995.468695:0:17160:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783141995.468714:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3807f3e 00000100:00080000:1.0:1783141995.468724:0:17160:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783141995.468730:0:17160:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9b4414e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141995.468765:0:17160:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44157b80 x1869759521122816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783141995.468798:0:17160:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783141995.468872:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141995.468876:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.468878:0:17160:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783141995.468882:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783141995.468884:0:17160:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1783141995.468886:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783141995.468887:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783141995.468900:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783141995.468903:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.468905:0:17160:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783141995.468908:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783141995.468913:0:17160:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783141995.468916:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141995.468917:0:17160:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783141995.468920:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783141995.468924:0:17160:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:1.0:1783141995.468946:0:17160:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783141995.468948:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141995.468961:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f9b432b99c0) 00000020:00000080:1.0:1783141995.468973:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1783141995.468979:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783141995.469038:0:17160:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783141995.469044:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783141995.469049:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807f4c 00010000:00080000:1.0:1783141995.469089:0:17160:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c760a5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783141995.469406:0:17160:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1783141995.469751:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521122816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783141995.469815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.469878:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521122816 00000100:00100000:0.0:1783141995.469886:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521122816 00000100:00100000:0.0:1783141995.469995:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141995.470003:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1869759521122816:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1783141995.470019:0:17147:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1783141995.472489:0:17160:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783141995.473175:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783141995.480153:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141995.481104:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783141995.488228:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1783141995.492190:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1869759521122816:12345-0@lo:38:llog_process_th.0 Request processed in 22179us (22367us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783141995.492203:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783141995.493036:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783141995.493044:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783141995.493049:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521122816:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783141995.494025:0:17166:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783141995.494032:0:17166:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783141995.494596:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783141995.494608:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783141995.494779:0:17160:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783141995.494800:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3807f53 00000100:00080000:0.0:1783141995.494976:0:17160:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141995.494982:0:17160:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f9c760a5000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141995.495013:0:17160:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1f80 x1869759521122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141995.495077:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521122944:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783141995.495145:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521122944 offset 0 length 520: 4 00000100:00080000:0.0:1783141995.495201:0:17160:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783141995.495326:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.495331:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.495333:0:17160:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783141995.495337:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783141995.495339:0:17160:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1783141995.495341:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141995.495342:0:17160:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141995.495344:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783141995.495346:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.495348:0:17160:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783141995.495351:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141995.495365:0:17160:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783141995.495369:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.495370:0:17160:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783141995.495374:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141995.495378:0:17160:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:0.0:1783141995.495398:0:17160:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783141995.495401:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141995.495412:0:17160:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f9b430119c0) 00000020:00000080:0.0:1783141995.495424:0:17160:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1783141995.495428:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141995.495485:0:17160:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783141995.495490:0:17160:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1783141995.495495:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb31399d6a3807f61 00010000:00080000:0.0:1783141995.495521:0:17160:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b41a0f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783141995.495915:0:17160:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783141995.495978:0:17160:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783141995.495992:0:17160:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783141995.498396:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141995.498788:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783141995.499014:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783141995.499660:0:17168:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783141995.499666:0:17168:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783141995.500594:0:17160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783141995.500605:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783141995.500652:0:17160:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783141995.500670:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3807f68 00000100:00080000:0.0:1783141995.500788:0:17160:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141995.500795:0:17160:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783141995.500949:0:17160:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e2300 x1869759521123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141995.501011:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521123072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783141995.501064:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521123072 offset 0 length 520: 4 00000100:00080000:0.0:1783141995.501118:0:17160:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783141995.501177:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.501181:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.501183:0:17160:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783141995.501186:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.501190:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.501191:0:17160:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783141995.501194:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783141995.501196:0:17160:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783141995.501198:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.501200:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.501201:0:17160:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783141995.501203:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.501205:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.501206:0:17160:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783141995.501209:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783141995.501240:0:17160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17160:1869759521123200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141995.501321:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.501337:0:17160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141995.501469:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123200 00000100:00100000:3.0:1783141995.501476:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123200 00000100:00100000:3.0:1783141995.501521:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141995.501529:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17160:x1869759521123200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141995.501654:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17160:x1869759521123200:12345-0@lo:502:llog_process_th.0 Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141995.501661:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783141995.501944:0:17160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17160:1869759521123200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141995.501963:0:17160:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.501966:0:17160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.501967:0:17160:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783141995.501971:0:17160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783141995.502111:0:17121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783141995.502128:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783141995.502169:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ee3 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.502177:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2000/0xb31399d6a3807edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ee3 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141995.502190:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c6f7af000 from 1 10000000:01000000:3.0:1783141995.502192:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783141995.502212:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.502217:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.502226:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141995.502239:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141995.502268:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.502488:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.502526:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123328 00000100:00100000:0.0:1783141995.502531:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123328 00000100:00100000:0.0:1783141995.502588:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783141995.502597:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+9:17121:x1869759521123328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141995.502607:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141995.502620:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807f6f expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.502639:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.502649:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.502657:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783141995.502704:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+10:17121:x1869759521123328:12345-0@lo:101:mount.lustre.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.502711:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141995.502769:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141995.502781:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.502789:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141995.503376:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123456:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783141995.503418:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.503510:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4ebdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.503541:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123456 00000100:00100000:0.0:1783141995.503545:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123456 00000100:00100000:0.0:1783141995.503575:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783141995.503582:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+10:17121:x1869759521123456:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783141995.503604:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783141995.503609:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783141995.503755:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+10:17121:x1869759521123456:12345-0@lo:256:mount.lustre.0 Request processed in 172us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.503762:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141995.503814:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123456:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783141995.504462:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783141995.504533:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.504545:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141995.504552:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f7af000 from 1 10000000:01000000:2.0:1783141995.504555:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141995.504583:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.504643:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.504652:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141995.504669:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783141995.504706:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.504734:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4ebdf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141995.505021:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123584 00000100:00100000:3.0:1783141995.505027:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123584 00000100:00100000:2.0:1783141995.505412:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141995.505424:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+10:17121:x1869759521123584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141995.505437:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141995.505451:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807f7d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.505471:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.505481:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.505487:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0400, rc 0) 00000100:00100000:2.0:1783141995.505525:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521123584:12345-0@lo:101:mount.lustre.0 Request processed in 104us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.505531:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783141995.505554:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141995.505567:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141995.505575:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141995.505742:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141995.505772:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.505916:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141995.506365:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123712 00000100:00100000:1.0:1783141995.506371:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123712 00000100:00100000:1.0:1783141995.506410:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141995.506418:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521123712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141995.506963:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521123712:12345-0@lo:501:mount.lustre.0 Request processed in 546us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141995.506972:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141995.507223:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141995.507260:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141995.507592:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.507744:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.507932:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123840 00000100:00100000:0.0:1783141995.507937:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123840 00000100:00100000:0.0:1783141995.507979:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141995.507986:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521123840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141995.508099:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521123840:12345-0@lo:503:mount.lustre.0 Request processed in 113us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.508106:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141995.508198:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521123840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141995.508857:0:17170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17170:1869759521123968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141995.508901:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.508938:0:17170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141995.508974:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521123968 00000100:00100000:1.0:1783141995.508979:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521123968 00000100:00100000:1.0:1783141995.509011:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783141995.509018:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17170:x1869759521123968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.509666:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17170:x1869759521123968:12345-0@lo:502:llog_process_th.0 Request processed in 647us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141995.509676:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141995.509896:0:17170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17170:1869759521123968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141995.509923:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.509932:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.509935:0:17170:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783141995.509942:0:17170:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6f7af000 00000020:00000080:0.0:1783141995.509945:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141995.509952:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.509955:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.509957:0:17170:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783141995.509959:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.509961:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.509962:0:17170:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783141995.509965:0:17170:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6f7af000 00000020:00000080:0.0:1783141995.509972:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141995.510032:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.510036:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.510037:0:17170:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783141995.510040:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.510042:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.510044:0:17170:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783141995.510047:0:17170:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6f7af000 00000020:00000080:0.0:1783141995.510049:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141995.510066:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.510068:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.510070:0:17170:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783141995.510072:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141995.510074:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.510076:0:17170:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783141995.510079:0:17170:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6f7af000 00000020:00000080:0.0:1783141995.510081:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783141995.510115:0:17170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17170:1869759521124096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141995.510552:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.510590:0:17170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c526ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141995.510647:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124096 00000100:00100000:2.0:1783141995.510653:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124096 00000100:00100000:2.0:1783141995.510688:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783141995.510696:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17170:x1869759521124096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141995.511070:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17170:x1869759521124096:12345-0@lo:502:llog_process_th.0 Request processed in 374us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.511078:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141995.511204:0:17170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17170:1869759521124096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141995.511228:0:17170:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141995.511234:0:17170:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141995.511236:0:17170:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783141995.511240:0:17170:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783141995.511699:0:17121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783141995.511944:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141995.511964:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141995.511974:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141995.512022:0:17121:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783141995.512025:0:17121:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c6f7af000 10000000:01000000:1.0:1783141995.512028:0:17121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c6f7af000 10000000:01000000:1.0:1783141995.512033:0:17121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141995.512038:0:17121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c6f7af000 from 1 10000000:01000000:1.0:1783141995.512040:0:17121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141995.512067:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141995.512076:0:17121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141995.512085:0:17121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141995.512113:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783141995.512268:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141995.512390:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.512493:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124224 00000100:00100000:0.0:1783141995.512499:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124224 00000100:00100000:0.0:1783141995.512532:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141995.512544:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17121:x1869759521124224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141995.512555:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141995.512572:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407e200/0xb31399d6a3807f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807f8b expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.512592:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407e200/0xb31399d6a3807f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807f8b expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.512603:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407e200/0xb31399d6a3807f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807f8b expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141995.512611:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e200, rc 0) 00000100:00100000:0.0:1783141995.512644:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521124224:12345-0@lo:101:mount.lustre.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.512651:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141995.512940:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141995.512954:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f92 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141995.512964:0:17121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807f92 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141995.513014:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141995.513038:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141995.513060:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.513373:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124352 00000100:00100000:0.0:1783141995.513427:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124352 00000100:00100000:0.0:1783141995.513904:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141995.513914:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521124352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141995.514029:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521124352:12345-0@lo:501:mount.lustre.0 Request processed in 116us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.514037:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141995.514091:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141995.514188:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141995.514227:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141995.514254:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.514343:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124480 00000100:00100000:0.0:1783141995.514347:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124480 00000100:00100000:0.0:1783141995.514378:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783141995.514546:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521124480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141995.514625:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521124480:12345-0@lo:503:mount.lustre.0 Request processed in 81us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141995.514665:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521124480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141995.515024:0:17172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.515056:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141995.515073:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124608 00000100:00100000:1.0:1783141995.515077:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124608 00000100:00100000:1.0:1783141995.515094:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783141995.515100:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+13:17172:x1869759521124608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.515175:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+13:17172:x1869759521124608:12345-0@lo:502:llog_process_th.0 Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141995.515182:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783141995.515219:0:17172:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141995.515231:0:17172:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124608:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783141995.515310:0:17172:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783141995.515326:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f9c6ccd99c0) 00000020:00000080:1.0:1783141995.515344:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783141995.515512:0:17172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6f7af000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783141995.515515:0:17172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6f7af000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783141995.515518:0:17172:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6f7af000 4 00010000:00080000:1.0:1783141995.515543:0:17172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c79baf800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783141995.517320:0:17172:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000100:00100000:0.0:1783141995.517406:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:00000080:1.0:1783141995.519442:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783141995.519498:0:17172:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783141995.519510:0:17172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb31399d6a3807fa0 00000100:00080000:1.0:1783141995.519519:0:17172:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783141995.519525:0:17172:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f9c79baf800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783141995.519558:0:17172:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44155f80 x1869759521124736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141995.519592:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521124736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783141995.519661:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783141995.520485:0:17172:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783141995.520693:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124736 00000100:00100000:1.0:1783141995.520700:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124736 00000100:00100000:1.0:1783141995.521464:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141995.521472:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759521124736:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783141995.521545:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759521124736:12345-0@lo:38:llog_process_th.0 Request processed in 72us (1884us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783141995.521552:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141995.521587:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141995.521595:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c79baf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141995.521600:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783141995.521604:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521124736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783141995.523018:0:17172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.523091:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141995.523126:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124864 00000100:00100000:1.0:1783141995.523133:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124864 00000100:00100000:1.0:1783141995.523173:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783141995.523182:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17172:x1869759521124864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141995.523330:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17172:x1869759521124864:12345-0@lo:502:llog_process_th.0 Request processed in 148us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141995.523337:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141995.525703:0:17172:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141995.525740:0:17172:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141995.525936:0:17172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141995.526002:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141995.526033:0:17172:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b410acf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.527983:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521124992 00000100:00100000:0.0:1783141995.528001:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521124992 00000100:00100000:0.0:1783141995.528061:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141995.528070:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17172:x1869759521124992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141995.528214:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17172:x1869759521124992:12345-0@lo:502:llog_process_th.0 Request processed in 144us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.528223:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141995.528315:0:17172:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17172:1869759521124992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783141995.528350:0:17172:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783141995.528885:0:17121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783141995.528911:0:17121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783141995.528927:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f92 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141995.528938:0:17121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f600/0xb31399d6a3807f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807f92 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783141995.528992:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783141995.528994:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783141995.528996:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141995.529003:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141995.529004:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141995.529006:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141995.529007:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783141995.529009:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783141995.529011:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141995.529012:0:17121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783141995.529016:0:17121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783141995.529018:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783141995.529019:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783141995.529020:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141995.529021:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141995.529022:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141995.529023:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141995.529024:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783141995.529025:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783141995.529026:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141995.529028:0:17121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783141995.529049:0:17121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783141995.529065:0:17121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521125120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783141995.529113:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141995.529150:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125120 00000100:00100000:0.0:1783141995.529155:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125120 00000100:00100000:1.0:1783141995.529169:0:17121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141995.529190:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783141995.529199:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521125120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783141995.529221:0:17135:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783141995.529234:0:17135:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783141995.533417:0:17135:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783141995.533437:0:17135:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783141995.533694:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17121:x1869759521125120:12345-0@lo:253:mount.lustre.0 Request processed in 4491us (4577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141995.533717:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141995.533725:0:17121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17121:1869759521125120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783141995.533740:0:17121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783141995.533743:0:17121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141995.533745:0:17121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141995.533747:0:17121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141995.533749:0:17121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141995.533750:0:17121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141995.533752:0:17121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141995.533754:0:17121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141995.533755:0:17121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141995.533757:0:17121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141995.533758:0:17121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783141995.533771:0:17121:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783141995.533932:0:17158:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783141995.533938:0:17158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783141995.533956:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.533970:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.533979:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534011:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 11 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534024:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 11 pid: 17135 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141995.534037:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521125248:0@lo:104: 00000100:00100000:2.0:1783141995.534069:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.534102:0:17158:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aa4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141995.534133:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125248 00000100:00100000:2.0:1783141995.534138:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125248 00000100:00100000:2.0:1783141995.534168:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141995.534181:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521125248:12345-0@lo:104: 00010000:00010000:2.0:1783141995.534192:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534232:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141995.534238:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521125248:12345-0@lo:104: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.534244:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783141995.534264:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141995.534840:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534850:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783141995.534854:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534864:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141995.534871:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141995.534877:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141995.534906:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534913:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141995.534932:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534950:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3807f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f76 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.534966:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.534968:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141995.534970:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141995.535002:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3655:1869759521125376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141995.535035:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141995.535111:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125376 00000100:00100000:2.0:1783141995.535116:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125376 00010000:00010000:2.0:1783141995.535135:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 12 pid: 17135 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141995.535156:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141995.535163:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:3655:x1869759521125376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141995.535174:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141995.535179:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 12 pid: 17135 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535188:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 12 pid: 17135 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535203:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535211:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141995.535223:0:17127:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001286386s 00010000:00010000:2.0:1783141995.535234:0:17127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535241:0:17127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535248:0:17127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535254:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535260:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783141995.535263:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535541:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535552:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535561:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141995.535594:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:3655:x1869759521125376:12345-0@lo:103:ldlm_bl.0 Request processed in 431us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141995.535602:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141995.535634:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3655:1869759521125376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141995.535656:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b4407e600/0xb31399d6a3807f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3807f6f expref: 11 pid: 17135 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141995.535666:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521125248:0@lo:104: 00010000:00010000:2.0:1783141995.535685:0:17158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535693:0:17158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535699:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141995.535721:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3807fa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783141995.561851:0:17121:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1783141995.562239:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783141995.562905:0:17183:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783141995.562920:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:1.0:1783141995.563748:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783141995.563781:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783141995.564233:0:17121:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783141995.564241:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783141995.564303:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141995.565221:0:17121:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1783141995.565432:0:17182:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783141995.565437:0:17182:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1783141995.565767:0:17121:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783141995.565797:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783141995.566083:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141995.568235:0:17183:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783141995.568324:0:17183:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1783141995.568553:0:17184:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f9b44156a00 x1869759521125504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141995.568570:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00000040:00080000:1.0:1783141995.569591:0:17121:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1783141995.570124:0:17121:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1783141995.571787:0:17121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1783141995.574068:0:17121:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783141995.574104:0:17121:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb17417e7988 00100000:10000000:3.0:1783141995.574111:0:17121:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783141995.581195:0:17121:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783141995.581213:0:17121:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783141995.581234:0:17121:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783141995.581255:0:17121:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783141995.582013:0:17121:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783141995.582205:0:17121:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783141996.228760:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783141996.551064:0:17178:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141996.551074:0:17178:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141996.553502:0:17178:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783141996.553516:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141996.613401:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:2.0:1783141997.252513:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783141997.252885:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783141997.252889:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c6f7af000 from 7 10000000:01000000:1.0:1783141997.252896:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783141997.252948:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141997.252960:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141997.252971:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141997.252996:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521125632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141997.253063:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141997.253136:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c43d5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141997.254842:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125632 00000100:00100000:2.0:1783141997.254857:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125632 00000100:00100000:2.0:1783141997.254927:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141997.254936:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+11:17140:x1869759521125632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141997.254952:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141997.254970:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807fae expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141997.254995:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807fae expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141997.255006:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807fae expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141997.255015:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0200, rc 0) 00000100:00100000:2.0:1783141997.255103:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17140:x1869759521125632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141997.255111:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141997.255229:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521125632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141997.255253:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141997.255263:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141997.255362:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521125760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783141997.255408:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141997.255447:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141997.255554:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125760 00000100:00100000:2.0:1783141997.255559:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125760 00000100:00100000:2.0:1783141997.255591:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783141997.255597:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17140:x1869759521125760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783141997.255610:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783141997.255625:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783141997.255628:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1783141997.255697:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17140:x1869759521125760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141997.255703:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783141997.255732:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521125760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783141997.255770:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783141997.255777:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141997.255785:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141997.572872:0:17178:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141997.572882:0:17178:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141997.573030:0:17178:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783141997.573074:0:17178:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141997.573207:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1783141997.637325:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:3.0:1783141998.278082:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141998.660629:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00000001:02000400:2.0:1783141998.789869:0:17427:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141999.300489:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783141999.581338:0:17479:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783141999.582513:0:17479:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783141999.686354:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00000020:00000004:3.0:1783142000.298689:0:17529:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783142000.299188:0:17529:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783142000.331427:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142000.710819:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00000100:00080000:0.0:1783142000.901582:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783142000.901590:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783142000.901593:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142000.901600:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1783142000.901606:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783142000.901611:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9b4414e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142000.901634:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1880 x1869759521126016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783142000.901648:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142000.901652:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142000.901654:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142000.901657:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142000.901660:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783142000.901663:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783142000.901678:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c79baf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142000.901683:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f9c79baf800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142000.901696:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e3100 x1869759521126144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783142000.901735:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783142000.901745:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521125888:0@lo:400:kworker.0 00000100:00100000:0.0:1783142000.901812:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142000.901887:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125888 00000100:00100000:0.0:1783142000.901894:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125888 00000100:00100000:0.0:1783142000.901933:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783142000.901942:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:3653:x1869759521125888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142000.901989:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:3653:x1869759521125888:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142000.901996:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783142000.902053:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521125888:0@lo:400:kworker.0 00000100:00100000:0.0:1783142000.902075:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521126016:0@lo:38:kworker.0 00000100:00100000:0.0:1783142000.902155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142000.902176:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521126144:0@lo:38:kworker.0 00000100:00100000:0.0:1783142000.902202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142000.902241:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126016 00000100:00100000:0.0:1783142000.902256:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126016 00000100:00100000:0.0:1783142000.902300:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783142000.902306:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521126016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783142000.902333:0:17148:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783142000.904471:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126144 00000100:00100000:3.0:1783142000.904484:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126144 00000100:00100000:3.0:1783142000.904524:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142000.904532:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1869759521126144:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783142000.904559:0:17144:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1783142000.904593:0:17144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb31399d6a3807fbc 00000004:00100000:3.0:1783142000.904607:0:17144:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783142000.904727:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9f9b41b15000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142000.904829:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1869759521126144:12345-0@lo:38:kworker.0 Request processed in 285us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142000.904836:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783142000.904895:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f9b441e3100 x1869759521126144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783142000.904910:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783142000.904917:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783142000.904921:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783142000.904923:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c79baf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783142000.904929:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1869759521126144:0@lo:38:kworker.0 00000100:00100000:0.0:1783142000.931148:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521126016:12345-0@lo:38:kworker.0 Request processed in 28830us (28981us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783142000.931175:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783142000.931473:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783142000.931480:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783142000.931484:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521126016:0@lo:38:kworker.0 00010000:00010000:2.0:1783142001.348518:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142001.734407:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:2.0:1783142002.372436:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142002.756485:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:2.0:1783142003.402119:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142003.780567:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:3.0:1783142004.422366:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142004.806899:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:2.0:1783142005.447647:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783142005.710247:0:17874:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783142005.710251:0:17874:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783142005.710252:0:17874:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783142005.710465:0:17874:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9b432c5800 00000020:01000004:3.0:1783142005.710481:0:17874:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1783142005.710493:0:17874:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783142005.710507:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f9b423019c0) 00000020:00000080:3.0:1783142005.710521:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783142005.756658:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783142005.758878:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783142005.760714:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1783142005.761055:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.761498:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.761672:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.762026:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.762342:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.762549:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783142005.762777:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783142005.763100:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783142005.763475:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783142005.764095:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783142005.764458:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1783142005.765489:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.765786:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.766123:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.766409:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.766581:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.766864:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.767127:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.767418:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.767596:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.767872:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.768210:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.768526:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.768701:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.769079:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.769351:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.769573:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.769790:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.770123:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.770398:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.770630:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.770953:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.771136:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.771395:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.771849:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.772131:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.772440:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.772652:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783142005.772972:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.773575:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.773816:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.774131:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783142005.774443:0:17874:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:3.0:1783142005.777086:0:17874:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783142005.777608:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783142005.777618:0:17874:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783142005.777630:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3807fca 00000020:01000004:3.0:1783142005.777636:0:17874:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783142005.777657:0:17874:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783142005.777660:0:17874:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783142005.777666:0:17874:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783142005.777693:0:17874:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783142005.777697:0:17874:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783142005.781973:0:17874:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783142005.782016:0:17874:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783142005.782020:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783142005.782022:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.782024:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.782025:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.782029:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.782031:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.782032:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.782034:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.782035:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783142005.782038:0:17874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783142005.782040:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783142005.782041:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.782042:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.782043:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.782044:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.782045:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.782046:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.782047:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.782048:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783142005.782073:0:17874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783142005.782091:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783142005.782231:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.782371:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.782415:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126272 00000100:00100000:1.0:1783142005.782423:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126272 00000100:00100000:1.0:1783142005.782524:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783142005.782534:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17874:x1869759521126272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783142005.782570:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783142005.782574:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783142005.782581:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783142005.783024:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17874:x1869759521126272:12345-0@lo:253:mount.lustre.0 Request processed in 490us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.783038:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783142005.783174:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783142005.783185:0:17874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783142005.783188:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783142005.783189:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.783191:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.783192:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.783193:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.783194:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.783195:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.783196:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.783197:0:17874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783142005.783213:0:17874:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9b432c5800 from lustre-MDT0001 10000000:01000000:3.0:1783142005.783240:0:17874:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783142005.783243:0:17874:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783142005.783249:0:17874:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9b42300000 local copy 00010000:00010000:3.0:1783142005.783258:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.783397:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142005.783429:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.783772:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.784003:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126400 00000100:00100000:0.0:1783142005.784009:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126400 00000100:00100000:0.0:1783142005.784040:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783142005.784046:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17874:x1869759521126400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142005.784120:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17874:x1869759521126400:12345-0@lo:501:mount.lustre.0 Request processed in 73us (690us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783142005.784127:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783142005.784251:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783142005.784265:0:17874:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783142005.784321:0:17874:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783142005.784328:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.784336:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.784363:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9b432c5800 10000000:01000000:3.0:1783142005.784367:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783142005.784372:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f9b42300000 10000000:01000000:3.0:1783142005.784375:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783142005.784378:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9f9b42300000 from 1 10000000:01000000:3.0:1783142005.784381:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783142005.784405:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.784414:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.784423:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.784451:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142005.784480:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.784500:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.784550:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126528 00000100:00100000:0.0:1783142005.784555:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126528 00000100:00100000:0.0:1783142005.784574:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783142005.784580:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+12:17874:x1869759521126528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783142005.784589:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142005.784602:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407fe00/0xb31399d6a3807fd8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807fd1 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.784620:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407fe00/0xb31399d6a3807fd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807fd1 expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.784630:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407fe00/0xb31399d6a3807fd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807fd1 expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.784639:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fe00, rc 0) 00000100:00100000:0.0:1783142005.784674:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+13:17874:x1869759521126528:12345-0@lo:101:mount.lustre.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142005.784680:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783142005.784909:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783142005.784921:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fd8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.784930:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807fd8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.784942:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783142005.785036:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fd8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785044:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2800/0xb31399d6a3807fd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fd8 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.785051:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f9b432c5800 10000000:01000000:3.0:1783142005.785055:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783142005.785058:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f9b432c5800 from 1 10000000:01000000:3.0:1783142005.785060:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783142005.785073:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785080:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785088:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.785105:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142005.785131:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.785160:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c540 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.785254:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126656 00000100:00100000:1.0:1783142005.785259:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126656 00000100:00100000:1.0:1783142005.785320:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783142005.785327:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+13:17874:x1869759521126656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142005.785335:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142005.785345:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168f000/0xb31399d6a3807fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807fdf expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.785359:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168f000/0xb31399d6a3807fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807fdf expref: 14 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.785367:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168f000/0xb31399d6a3807fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807fdf expref: 14 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.785374:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168f000, rc 0) 00000100:00100000:1.0:1783142005.785403:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+14:17874:x1869759521126656:12345-0@lo:101:mount.lustre.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.785409:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783142005.785499:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783142005.785508:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fe6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785516:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807fe6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.785526:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783142005.785934:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fe6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785942:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3c00/0xb31399d6a3807fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807fe6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.785948:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783142005.785952:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783142005.785956:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f9b432c5800 10000000:01000000:3.0:1783142005.785959:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783142005.785962:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783142005.785964:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783142005.785980:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.785986:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.786001:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.786015:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142005.786045:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.786075:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621c540 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.786118:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126784 00000100:00100000:1.0:1783142005.786123:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126784 00000100:00100000:1.0:1783142005.786161:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783142005.786168:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+14:17874:x1869759521126784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142005.786177:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142005.786185:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168e600/0xb31399d6a3807ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3807fed expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.786198:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168e600/0xb31399d6a3807ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3807fed expref: 15 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.786212:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168e600/0xb31399d6a3807ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807fed expref: 15 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.786218:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e600, rc 0) 00000100:00100000:1.0:1783142005.786254:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521126784:12345-0@lo:101:mount.lustre.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.786260:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783142005.786413:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142005.786424:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ff4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.786431:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3807ff4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783142005.788169:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1783142005.788779:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783142005.797073:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783142005.797127:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1783142005.797143:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1783142005.797155:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1783142005.797168:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1783142005.797180:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1783142005.797192:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1783142005.797203:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1783142005.797218:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1783142005.797232:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1783142005.797245:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1783142005.797257:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1783142005.797268:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1783142005.797320:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1783142005.797335:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1783142005.797346:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1783142005.797359:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1783142005.797372:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1783142005.797386:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1783142005.797398:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1783142005.797415:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1783142005.797429:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1783142005.797442:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1783142005.797466:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1783142005.797472:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1783142005.797560:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142005.797617:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.797905:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.797996:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521126912 00000100:00100000:0.0:1783142005.798010:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521126912 00000100:00100000:0.0:1783142005.798102:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783142005.798111:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521126912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142005.798238:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521126912:12345-0@lo:501:mount.lustre.0 Request processed in 128us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142005.798245:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783142005.798337:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521126912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142005.798366:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142005.798411:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.798510:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.798537:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127040 00000100:00100000:1.0:1783142005.798541:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127040 00000100:00100000:1.0:1783142005.798561:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783142005.798568:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783142005.799513:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127040:12345-0@lo:503:mount.lustre.0 Request processed in 941us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.799522:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783142005.799608:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783142005.800033:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783142005.800105:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.800147:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.800188:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.800516:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127168 00000100:00100000:1.0:1783142005.800522:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127168 00000100:00100000:1.0:1783142005.800548:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783142005.800554:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142005.801542:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127168:12345-0@lo:502:mount.lustre.0 Request processed in 984us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.801551:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783142005.801727:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.802091:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783142005.802123:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1783142005.802137:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1783142005.802153:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1783142005.802166:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1783142005.802180:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1783142005.802192:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1783142005.802203:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1783142005.802216:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1783142005.802231:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1783142005.802244:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1783142005.802258:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1783142005.802314:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1783142005.802331:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1783142005.802344:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1783142005.802357:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1783142005.802369:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1783142005.802381:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1783142005.802393:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1783142005.802406:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1783142005.802418:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1783142005.802429:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1783142005.802451:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1783142005.802465:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1783142005.802478:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1783142005.802491:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1783142005.802504:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1783142005.802516:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1783142005.802528:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1783142005.802540:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1783142005.802553:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1783142005.802566:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1783142005.802578:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1783142005.802592:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1783142005.802607:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1783142005.802620:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1783142005.803697:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1783142005.803887:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1783142005.803906:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1783142005.803919:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1783142005.803931:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1783142005.803944:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1783142005.803956:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1783142005.803968:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1783142005.804008:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142005.804079:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.804172:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7621cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.804237:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127296 00000100:00100000:0.0:1783142005.804245:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127296 00000100:00100000:1.0:1783142005.804411:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783142005.804422:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142005.804575:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521127296:12345-0@lo:502:mount.lustre.0 Request processed in 155us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.804591:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783142005.804920:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521127296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.804976:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1783142005.804985:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1783142005.805967:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142005.805979:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142005.805981:0:17878:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783142005.805988:0:17878:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783142005.805991:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783142005.806004:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f9b43014d40) 00000020:00000080:0.0:1783142005.806022:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1783142005.806028:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783142005.806096:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783142005.806103:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3808002 00000020:00000080:0.0:1783142005.806393:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783142005.806398:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142005.806401:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142005.806403:0:17878:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783142005.806406:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142005.806409:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142005.806410:0:17878:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783142005.806413:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783142005.806420:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f9b43013380) 00000020:00000080:0.0:1783142005.806430:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1783142005.806434:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783142005.806436:0:17878:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783142005.806438:0:17878:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783142005.806451:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783142005.806503:0:17878:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9b432c5800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783142005.806515:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f9c7b660000) 00000020:00000080:0.0:1783142005.806525:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1783142005.806581:0:17878:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783142005.806586:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3808017 00000020:00000080:0.0:1783142005.807251:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783142005.807261:0:17878:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783142005.807266:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb31399d6a380801e 00080000:01000000:0.0:1783142005.807443:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783142005.807449:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3808025 00000100:00100000:2.0:1783142005.832247:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00010000:00010000:3.0:1783142005.896614:0:17878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1783142005.897138:0:17878:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1783142005.898528:0:17878:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783142005.908680:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783142005.908695:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142005.908702:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142005.908704:0:17878:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783142005.908708:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142005.908715:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142005.908717:0:17878:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783142005.908721:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783142005.908727:0:17878:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:0.0:1783142005.908753:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783142005.908770:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f9c7b664d40) 00000020:00000080:0.0:1783142005.908789:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1783142005.908795:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783142005.908866:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783142005.908873:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783142005.908880:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3808033 00010000:00080000:0.0:1783142005.909225:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c4b36c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783142005.913502:0:17878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1783142005.916580:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783142005.916594:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783142005.916628:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783142005.916649:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a380803a 00000100:00080000:3.0:1783142005.916660:0:17878:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783142005.916667:0:17878:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f9c4b36c800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783142005.916700:0:17878:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b442cbb80 x1869759521127424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783142005.916720:0:17878:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783142005.916769:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.916773:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916775:0:17878:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783142005.916778:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783142005.916780:0:17878:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783142005.916782:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.916783:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.916785:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783142005.916787:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916788:0:17878:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783142005.916790:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142005.916795:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916797:0:17878:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783142005.916800:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783142005.916826:0:17878:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783142005.916836:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.916838:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916840:0:17878:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783142005.916842:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783142005.916844:0:17878:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1783142005.916845:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.916846:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.916848:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783142005.916855:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916857:0:17878:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783142005.916860:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783142005.916864:0:17878:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783142005.916867:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.916868:0:17878:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783142005.916871:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783142005.916874:0:17878:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:3.0:1783142005.916909:0:17878:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783142005.916912:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783142005.916925:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f9c48c28000) 00000020:00000080:3.0:1783142005.916938:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783142005.916943:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783142005.916999:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783142005.917005:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783142005.917010:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3808048 00010000:00080000:3.0:1783142005.917037:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c4b36b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783142005.917266:0:17878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1783142005.917944:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783142005.917951:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783142005.917954:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783142005.917961:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1783142005.917965:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783142005.917970:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9b4414e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783142005.917995:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80f800 x1869759521127552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783142005.918008:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142005.918011:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783142005.918014:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142005.918016:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783142005.918063:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783142005.918080:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521127680:0@lo:400:kworker.0 00000100:00100000:0.0:1783142005.918141:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521127424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783142005.919508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142005.919587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.919633:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521127552:0@lo:38:kworker.0 00000100:00100000:0.0:1783142005.919791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.919845:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127424 00000100:00100000:0.0:1783142005.919851:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127424 00000100:00100000:0.0:1783142005.919872:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127552 00000100:00100000:0.0:1783142005.919874:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127552 00000100:00100000:0.0:1783142005.919884:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783142005.919890:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521127424:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783142005.919915:0:17148:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:0.0:1783142005.920069:0:17148:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a380804f 00000004:00100000:0.0:1783142005.920084:0:17148:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783142005.920090:0:17148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1783142005.920622:0:17878:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783142005.920789:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127680 00000100:00100000:3.0:1783142005.920795:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127680 00000100:00100000:3.0:1783142005.920837:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783142005.920844:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521127680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142005.920911:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521127680:12345-0@lo:400:kworker.0 Request processed in 66us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.920920:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783142005.920960:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f9c6f80e680 x1869759521127680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142005.920973:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521127680:0@lo:400:kworker.0 00000040:01000000:0.0:1783142005.921368:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783142005.925153:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783142005.925510:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783142005.925668:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1783142005.926122:0:17883:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783142005.926131:0:17883:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1783142005.927371:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9f9c44217800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783142005.927459:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759521127424:12345-0@lo:38:llog_process_th.0 Request processed in 7567us (7950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.927474:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142005.927506:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783142005.927512:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521127552:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783142005.927555:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521127552:12345-0@lo:38:kworker.0 Request processed in 42us (7772us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783142005.927562:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783142005.927695:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783142005.927705:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783142005.927713:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783142005.927718:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783142005.927721:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783142005.927749:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521127424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783142005.927763:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783142005.927767:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783142005.927771:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783142005.927774:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521127552:0@lo:38:kworker.0 00000100:00100000:0.0:1783142005.927986:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521127808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783142005.928024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142005.928098:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521127808 00000100:00100000:1.0:1783142005.928105:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521127808 00000100:00100000:1.0:1783142005.928155:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142005.928163:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521127808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783142005.928187:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783142005.928578:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1869759521127808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 415us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.928586:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783142005.928661:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521127808:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1783142005.929092:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783142005.929104:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783142005.929151:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783142005.929168:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a3808056 00000100:00080000:3.0:1783142005.929174:0:17878:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783142005.929179:0:17878:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f9c4b36b800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783142005.929201:0:17878:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b442cad80 x1869759521127936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783142005.929226:0:17878:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783142005.929324:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.929329:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.929331:0:17878:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783142005.929335:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783142005.929338:0:17878:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783142005.929340:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.929341:0:17878:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783142005.929343:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783142005.929346:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.929348:0:17878:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000100:00080000:2.0:1783142005.929348:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:3.0:1783142005.929353:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1783142005.929355:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1783142005.929359:0:17878:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783142005.929363:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.929364:0:17878:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783142005.929367:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783142005.929372:0:17878:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000100:00080000:2.0:1783142005.929377:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142005.929382:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1783142005.929398:0:17878:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783142005.929402:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783142005.929413:0:17878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f9c48c299c0) 00000020:00000080:3.0:1783142005.929425:0:17878:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783142005.929429:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1783142005.929482:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521127936:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783142005.929499:0:17878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783142005.929506:0:17878:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783142005.929513:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb31399d6a3808064 00000400:00000100:0.0:1783142005.929520:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521127936 offset 0 length 520: 4 00010000:00080000:3.0:1783142005.929556:0:17878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b427f3000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783142005.929750:0:17878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783142005.929812:0:17878:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783142005.929827:0:17878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783142005.932878:0:17878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783142005.934615:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783142005.935072:0:17878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783142005.936598:0:17885:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783142005.936605:0:17885:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783142005.942607:0:17878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783142005.942621:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783142005.942674:0:17878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783142005.942694:0:17878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a380806b 00000100:00080000:3.0:1783142005.942705:0:17878:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783142005.942711:0:17878:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9b427f3000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783142005.942742:0:17878:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b442cb100 x1869759521128064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783142005.942760:0:17878:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783142005.942813:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.942817:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.942819:0:17878:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783142005.942822:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142005.942825:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.942827:0:17878:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783142005.942830:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783142005.942832:0:17878:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783142005.942834:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.942836:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.942837:0:17878:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783142005.942839:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142005.942849:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.942851:0:17878:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783142005.942854:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783142005.942882:0:17878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142005.942885:0:17878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142005.942897:0:17878:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783142005.942907:0:17878:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1783142005.943041:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 00000100:00080000:1.0:1783142005.943310:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783142005.943315:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783142005.943317:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142005.943323:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9b4414e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142005.943338:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44155180 x1869759521128320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783142005.943347:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142005.943350:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142005.943352:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142005.943355:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783142005.943402:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521128064:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783142005.943465:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521128064 offset 0 length 520: 4 00000100:00100000:0.0:1783142005.943505:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521128320:0@lo:38:kworker.0 00000100:00080000:1.0:1783142005.943512:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783142005.943534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.943568:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128320 00000100:00080000:1.0:1783142005.943575:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783142005.943575:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128320 00000100:00100000:1.0:1783142005.943593:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783142005.943604:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521128192:0@lo:400:kworker.0 00000100:00100000:0.0:1783142005.943610:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783142005.943617:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521128320:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783142005.943641:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.943673:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1869759521128320:12345-0@lo:38:kworker.0 Request processed in 53us (136us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783142005.943674:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521128576:0@lo:400:kworker.0 00000100:00100000:0.0:1783142005.943688:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783142005.943709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783142005.943723:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783142005.943728:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783142005.943732:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783142005.943733:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521128320:0@lo:38:kworker.0 00000100:00100000:1.0:1783142005.943741:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521128448:0@lo:400:kworker.0 00000100:00100000:1.0:1783142005.943768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142005.943794:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128192 00000100:00100000:1.0:1783142005.943798:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128192 00000100:00100000:1.0:1783142005.943835:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783142005.943842:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:3654:x1869759521128192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142005.943879:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:3654:x1869759521128192:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.943886:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783142005.943916:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128448 00000100:00100000:1.0:1783142005.943920:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128448 00000100:00100000:1.0:1783142005.943951:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783142005.943957:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521128448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142005.943992:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521128448:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.943999:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1783142005.944216:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783142005.944232:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ff4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.944243:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2c00/0xb31399d6a3807fed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ff4 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.944250:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9b432c5800 from 1 10000000:01000000:3.0:1783142005.944253:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783142005.944299:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.944308:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.944318:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.944332:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142005.944563:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.944582:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df540 going to sleep for 11 seconds 00000100:00100000:2.0:1783142005.944811:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521128192:0@lo:400:kworker.0 00000100:00100000:2.0:1783142005.944831:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128576 00000100:00100000:2.0:1783142005.944835:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128576 00000100:00100000:2.0:1783142005.944857:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783142005.944863:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1869759521128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142005.944978:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128704 00000100:00100000:1.0:1783142005.944982:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128704 00000100:00100000:1.0:1783142005.945025:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783142005.945033:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+15:17874:x1869759521128704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142005.945043:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142005.945499:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808072 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142005.945615:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1869759521128576:12345-0@lo:400:kworker.0 Request processed in 38us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.945623:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783142005.945673:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808072 expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.945685:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808072 expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.945694:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168fc00, rc 0) 00000100:00100000:1.0:1783142005.945737:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17874:x1869759521128704:12345-0@lo:101:mount.lustre.0 Request processed in 705us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.945744:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1783142005.945785:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f9b44154380 x1869759521128448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142005.945798:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521128448:0@lo:400:kworker.0 00000100:00100000:1.0:1783142005.945810:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521128576:0@lo:400:kworker.0 00000100:00100000:3.0:1783142005.945874:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783142005.945888:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.945979:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.947260:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128832:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783142005.947353:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.947755:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c760df540 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.947795:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128832 00000100:00100000:1.0:1783142005.947802:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128832 00000100:00100000:1.0:1783142005.947851:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783142005.947858:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17874:x1869759521128832:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783142005.947876:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783142005.947893:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783142005.947896:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783142005.948266:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17874:x1869759521128832:12345-0@lo:256:mount.lustre.0 Request processed in 406us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.948324:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783142005.948630:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128832:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783142005.949873:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783142005.949992:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.950004:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783142005.950336:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9b432c5800 from 1 10000000:01000000:2.0:1783142005.950339:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783142005.950497:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.950505:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.950514:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142005.950595:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783142005.950649:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.950734:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49347180 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.950822:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521128960 00000100:00100000:1.0:1783142005.950830:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521128960 00000100:00100000:1.0:1783142005.950869:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783142005.950878:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17874:x1869759521128960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142005.950893:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142005.951491:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808080 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.951579:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808080 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.951591:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808080 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.951599:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e400, rc 0) 00000100:00100000:1.0:1783142005.951694:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521128960:12345-0@lo:101:mount.lustre.0 Request processed in 816us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.951702:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783142005.951768:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521128960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142005.951782:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.951791:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783142005.951979:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783142005.952102:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142005.952189:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.952259:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.952472:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129088 00000100:00100000:1.0:1783142005.952478:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129088 00000100:00100000:1.0:1783142005.952513:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783142005.952581:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142005.952710:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129088:12345-0@lo:501:mount.lustre.0 Request processed in 191us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.952719:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783142005.952790:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142005.952814:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142005.952849:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.952914:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.953003:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129216 00000100:00100000:1.0:1783142005.953007:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129216 00000100:00100000:1.0:1783142005.953038:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783142005.953045:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783142005.953634:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129216:12345-0@lo:503:mount.lustre.0 Request processed in 587us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.953641:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783142005.953764:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783142005.954712:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783142005.954784:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.954836:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.954875:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.954938:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129344 00000100:00100000:1.0:1783142005.954944:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129344 00000100:00100000:1.0:1783142005.954981:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783142005.954988:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142005.955096:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129344:12345-0@lo:502:mount.lustre.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.955103:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783142005.955194:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783142005.955428:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783142005.955454:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1783142005.955468:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1783142005.955481:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1783142005.955493:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1783142005.955505:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1783142005.955529:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1783142005.955546:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1783142005.955556:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783142005.955569:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1783142005.955582:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1783142005.955602:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.955634:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.955653:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142005.955904:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129472 00000100:00100000:1.0:1783142005.955909:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129472 00000100:00100000:1.0:1783142005.955944:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783142005.955951:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142005.956024:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129472:12345-0@lo:502:mount.lustre.0 Request processed in 72us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142005.956031:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783142005.956117:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.956172:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1783142005.956190:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783142005.957733:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142005.957748:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957750:0:17887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783142005.957757:0:17887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9b432c5800 00000020:00000080:2.0:1783142005.957760:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142005.957767:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142005.957770:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957771:0:17887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783142005.957773:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142005.957775:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957784:0:17887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783142005.957789:0:17887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9b432c5800 00000020:00000080:2.0:1783142005.957791:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142005.957856:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142005.957860:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957862:0:17887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783142005.957864:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142005.957867:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957868:0:17887:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783142005.957872:0:17887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9b432c5800 00000020:00000080:2.0:1783142005.957874:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142005.957888:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142005.957891:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957892:0:17887:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783142005.957894:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142005.957896:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957897:0:17887:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783142005.957901:0:17887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9b432c5800 00000020:00000080:2.0:1783142005.957902:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142005.957925:0:17887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142005.957928:0:17887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142005.957929:0:17887:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783142005.957932:0:17887:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1783142005.958352:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783142005.958490:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783142005.958515:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.958587:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783142005.958653:0:17874:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783142005.958655:0:17874:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9b432c5800 10000000:01000000:0.0:1783142005.958659:0:17874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9b432c5800 10000000:01000000:0.0:1783142005.958663:0:17874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783142005.958668:0:17874:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9b432c5800 from 1 10000000:01000000:0.0:1783142005.958670:0:17874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783142005.958701:0:17874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.958710:0:17874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142005.958721:0:17874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142005.958741:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783142005.958794:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.958838:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1783142005.958957:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129600 00000100:00100000:2.0:1783142005.958964:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129600 00000100:00100000:2.0:1783142005.958997:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783142005.959005:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17874:x1869759521129600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142005.959019:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142005.959030:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a3808095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380808e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.959050:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a3808095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380808e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.959068:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0a00/0xb31399d6a3808095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380808e expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142005.959083:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0a00, rc 0) 00000100:00100000:2.0:1783142005.959478:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129600:12345-0@lo:101:mount.lustre.0 Request processed in 472us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.959486:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783142005.959664:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142005.959683:0:17874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808095 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142005.959692:0:17874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808095 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783142005.969684:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783142005.969986:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783142005.970355:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783142005.970381:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1783142005.970394:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1783142005.970405:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1783142005.970418:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1783142005.970430:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1783142005.970442:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1783142005.970454:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1783142005.970467:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1783142005.970492:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1783142005.970506:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1783142005.970520:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1783142005.970534:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1783142005.970546:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1783142005.970558:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1783142005.970570:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1783142005.970585:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1783142005.970600:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1783142005.970613:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1783142005.970625:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1783142005.970637:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1783142005.970649:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1783142005.970661:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1783142005.970674:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1783142005.970685:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1783142005.970698:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1783142005.970709:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1783142005.970720:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1783142005.972089:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1783142005.972105:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783142005.972262:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142005.972351:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142005.972406:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.972886:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129728 00000100:00100000:0.0:1783142005.972893:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129728 00000100:00100000:0.0:1783142005.973103:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783142005.973113:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142005.973403:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129728:12345-0@lo:501:mount.lustre.0 Request processed in 291us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.973431:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142005.973436:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783142005.973479:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142005.973525:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.973555:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.974090:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129856 00000100:00100000:0.0:1783142005.974095:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129856 00000100:00100000:0.0:1783142005.974129:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783142005.974138:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783142005.975059:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129856:12345-0@lo:503:mount.lustre.0 Request processed in 920us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142005.975069:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783142005.975804:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783142005.976209:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783142005.976330:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.976379:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142005.976412:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a4eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142005.976552:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521129984 00000100:00100000:0.0:1783142005.976558:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521129984 00000100:00100000:0.0:1783142005.976603:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783142005.976611:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142005.976706:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521129984:12345-0@lo:502:mount.lustre.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142005.976714:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783142005.980483:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521129984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.980713:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1783142005.981105:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1783142005.981121:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1783142005.981135:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1783142005.981148:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1783142005.981160:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1783142005.981171:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1783142005.981182:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1783142005.981194:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1783142005.981206:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1783142005.981219:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1783142005.981230:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1783142005.981242:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1783142005.981254:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1783142005.981265:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1783142005.981312:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1783142005.981339:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1783142005.981353:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1783142005.981365:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1783142005.981376:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1783142005.981387:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1783142005.981401:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1783142005.981413:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1783142005.981426:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1783142005.981438:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1783142005.981450:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1783142005.981461:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1783142005.981472:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1783142005.981484:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1783142005.981497:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1783142005.981509:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1783142005.981524:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1783142005.981537:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1783142005.981549:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1783142005.981561:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1783142005.981573:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1783142005.981586:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1783142005.981598:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1783142005.981610:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1783142005.981621:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1783142005.981633:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1783142005.981646:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1783142005.981657:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1783142005.981671:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1783142005.981683:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1783142005.981695:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1783142005.981707:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1783142005.981718:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1783142005.981926:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142005.982005:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.982082:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783142005.982405:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130112 00000100:00100000:2.0:1783142005.982412:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130112 00000100:00100000:2.0:1783142005.982460:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783142005.982468:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521130112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.983957:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521130112:12345-0@lo:502:mount.lustre.0 Request processed in 1482us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.983970:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783142005.987072:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.987324:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1783142005.987352:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1783142005.987387:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142005.987453:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.987495:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783142005.987564:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130240 00000100:00100000:2.0:1783142005.987576:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130240 00000100:00100000:2.0:1783142005.987620:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783142005.987628:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521130240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142005.987843:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521130240:12345-0@lo:502:mount.lustre.0 Request processed in 215us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142005.987850:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783142005.987977:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142005.988020:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1783142005.988029:0:17874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1783142005.989099:0:17893:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1783142005.989114:0:17893:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f9b41b18000) 00000020:00000080:2.0:1783142005.989133:0:17893:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783142005.989384:0:17893:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9b432c5800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783142005.989388:0:17893:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9b432c5800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783142005.989391:0:17893:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9b432c5800 3 00010000:00080000:2.0:1783142005.989418:0:17893:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b437db000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1783142005.991209:0:17893:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1783142005.991858:0:17893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1783142005.991899:0:17893:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783142005.991910:0:17893:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb31399d6a38080a3 00000100:00080000:2.0:1783142005.991919:0:17893:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783142005.991925:0:17893:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f9b437db000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783142005.991957:0:17893:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80d880 x1869759521130368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783142005.991985:0:17893:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783142005.992046:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759521130368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783142005.992112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783142005.993641:0:17893:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1783142005.993863:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130368 00000100:00100000:3.0:1783142005.993871:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130368 00000100:00100000:3.0:1783142005.993906:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783142005.993913:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1869759521130368:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783142005.993937:0:17144:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1783142005.993983:0:17144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb31399d6a38080aa 00000004:00100000:3.0:1783142005.993998:0:17144:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783142005.994027:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142005.994099:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1869759521130368:12345-0@lo:38:llog_process_th.0 Request processed in 185us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.994107:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783142005.994154:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f9c6f80d880 x1869759521130368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142005.994165:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783142005.994180:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783142005.994187:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783142005.994191:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783142005.994193:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b437db000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783142005.994199:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1869759521130368:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1783142005.994228:0:17874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783142005.994259:0:17874:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783142005.994303:0:17874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808095 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.994313:0:17874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407fc00/0xb31399d6a380808e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808095 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783142005.994365:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783142005.994367:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.994368:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.994369:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.994370:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.994371:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.994373:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.994374:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.994375:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783142005.994379:0:17874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1783142005.994381:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783142005.994383:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.994384:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.994385:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.994385:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.994386:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.994387:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.994388:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.994389:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783142005.994406:0:17874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783142005.994419:0:17874:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783142005.994461:0:17874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.994485:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130496 00000100:00100000:3.0:1783142005.994489:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130496 00000100:00100000:3.0:1783142005.994516:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783142005.994521:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17874:x1869759521130496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783142005.994543:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783142005.994555:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783142005.994669:0:17874:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a9240 going to sleep for 11 seconds 00000100:00080000:1.0:1783142005.995061:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142005.995066:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142005.995069:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142005.995071:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142005.995074:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142005.995077:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:3.0:1783142005.995844:0:17122:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783142005.995915:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783142005.995930:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783142005.996065:0:17158:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783142005.996070:0:17158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783142005.996090:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996106:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807fae expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996114:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808072 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996121:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996151:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 18 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996163:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 18 pid: 17135 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.996175:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521130624:0@lo:104: 00000100:00100000:3.0:1783142005.996232:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783142005.996304:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996312:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 18 pid: 17137 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.996321:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521130752:0@lo:104: 00000100:00100000:3.0:1783142005.996345:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.996359:0:17158:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b426a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783142005.996387:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130624 00000100:00100000:3.0:1783142005.996392:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130624 00000100:00100000:3.0:1783142005.996415:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130752 00000100:00100000:3.0:1783142005.996418:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130752 00000100:00100000:3.0:1783142005.996430:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142005.996437:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521130624:12345-0@lo:104: 00010000:00010000:3.0:1783142005.996449:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996496:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783142005.996502:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521130624:12345-0@lo:104: Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.996509:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142005.996532:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783142005.996540:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521130752:12345-0@lo:104: 00010000:00010000:3.0:1783142005.996548:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996586:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783142005.996598:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521130752:12345-0@lo:104: Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.996604:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783142005.996629:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783142005.996635:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996642:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142005.996645:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996652:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142005.996659:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.996664:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783142005.996690:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996698:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142005.996718:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996724:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a3808072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808079 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996800:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142005.996803:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996819:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e800 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142005.996822:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996829:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142005.996834:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142005.996839:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783142005.996855:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996860:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142005.996869:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996874:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3807fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807fb5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.996888:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142005.996890:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142005.996893:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142005.996900:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142005.996917:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521130880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142005.996950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.996971:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783142005.996977:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521131008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142005.997011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142005.997045:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521130880 00000100:00100000:3.0:1783142005.997049:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521130880 00010000:00010000:3.0:1783142005.997066:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 19 pid: 17135 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.997085:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131008 00000100:00100000:3.0:1783142005.997088:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131008 00010000:00010000:3.0:1783142005.997098:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 20 pid: 17137 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.997108:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142005.997113:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:3654:x1869759521130880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142005.997122:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142005.997126:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 20 pid: 17135 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997134:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 20 pid: 17135 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997146:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142005.997171:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:3654:x1869759521130880:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.997176:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142005.997187:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783142005.997193:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:3654:x1869759521131008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142005.997200:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142005.997204:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 19 pid: 17137 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997223:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 19 pid: 17137 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997234:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997240:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783142005.997251:0:17127:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001286386s 00010000:00010000:3.0:1783142005.997255:0:17127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997261:0:17127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997266:0:17127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997301:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997308:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142005.997312:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997318:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997325:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997340:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142005.997364:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:3654:x1869759521131008:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142005.997370:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783142005.997407:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521131008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142005.997414:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521130880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142005.997439:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3808072 expref: 18 pid: 17135 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.997448:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521130624:0@lo:104: 00010000:00010000:3.0:1783142005.997455:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a3807fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3807fae expref: 17 pid: 17137 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142005.997463:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521130752:0@lo:104: 00010000:00010000:3.0:1783142005.997473:0:17158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997482:0:17158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997487:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142005.997493:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2a00/0xb31399d6a38080b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142005.997635:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17874:x1869759521130496:12345-0@lo:253:mount.lustre.0 Request processed in 3112us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142005.997644:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783142005.998161:0:17874:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17874:1869759521130496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783142005.998182:0:17874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783142005.998185:0:17874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783142005.998187:0:17874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783142005.998188:0:17874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783142005.998189:0:17874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783142005.998191:0:17874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783142005.998192:0:17874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783142005.998193:0:17874:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783142005.998195:0:17874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783142005.998196:0:17874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783142005.998206:0:17874:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1783142006.009402:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1783142006.009411:0:17898:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1783142006.009416:0:17898:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783142006.010873:0:17899:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783142006.011187:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1783142006.011391:0:17899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783142006.012458:0:17900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131136:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1783142006.012514:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1783142006.012527:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142006.012553:0:17900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c455dacc0 going to sleep for 11 seconds 00000040:00080000:2.0:1783142006.012560:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783142006.012996:0:17874:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783142006.013004:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1783142006.013041:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783142006.014097:0:17874:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783142006.014638:0:17874:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783142006.014667:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1783142006.014750:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783142006.015194:0:17874:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1783142006.016359:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131136 00000100:00100000:3.0:1783142006.016369:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131136 00000100:00100000:3.0:1783142006.016423:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783142006.016433:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131136:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783142006.016537:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131136:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142006.016544:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783142006.016686:0:17900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131136:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783142006.016722:0:17900:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783142006.016759:0:17900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783142006.016796:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142006.016818:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131264 00000100:00100000:1.0:1783142006.016822:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131264 00000100:00100000:1.0:1783142006.016856:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783142006.016863:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131264:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783142006.016961:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 99us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142006.016968:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783142006.016990:0:17900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c455dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142006.017002:0:17900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783142006.017048:0:17900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17900:1869759521131392:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783142006.017071:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142006.017084:0:17900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c455da240 going to sleep for 11 seconds 00000040:00080000:0.0:1783142006.017571:0:17899:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783142006.017631:0:17899:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1783142006.017687:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131392 00000100:00100000:0.0:1783142006.017692:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131392 00000100:00100000:0.0:1783142006.017725:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783142006.017902:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1869759521131392:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783142006.017953:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1869759521131392:12345-0@lo:900:lod0001_rec0000.0 Request processed in 53us (881us total) trans 0 rc 0/0 00000001:00000004:2.0:1783142006.019589:0:17874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1783142006.020899:0:17900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f9b44156d80 x1869759521131392/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783142022 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142006.020915:0:17900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17900:1869759521131392:0@lo:900:lod0001_rec0000.0 00000001:00080000:2.0:1783142006.020920:0:17874:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783142006.020950:0:17874:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1741c8b988 00100000:10000000:2.0:1783142006.020958:0:17874:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1783142006.020985:0:17900:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783142006.021039:0:17900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142006.021070:0:17900:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c455dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783142006.021145:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131520 00000100:00100000:2.0:1783142006.021152:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131520 00000100:00100000:2.0:1783142006.021195:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783142006.021203:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783142006.021308:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17900:x1869759521131520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142006.021315:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783142006.021503:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783142006.023036:0:17900:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17900:1869759521131520:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783142006.023093:0:17900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:2.0:1783142006.023946:0:17874:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783142006.023972:0:17874:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783142006.023991:0:17874:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783142006.024005:0:17874:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:1.0:1783142006.025159:0:17900:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783142006.025213:0:17900:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783142006.025218:0:17900:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:2.0:1783142006.025919:0:17874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783142006.026154:0:17874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783142006.476201:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142006.855913:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 0 seconds 00000100:00100000:3.0:1783142007.044533:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141995/real 1783141995] req@ffff9f9b441e2300 x1869759521123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142007.044563:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b441e2300 x1869759521123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142007.044573:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141995/real 1783141995] req@ffff9f9b441e1f80 x1869759521122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142007.044584:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b441e1f80 x1869759521122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783142007.044599:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783142007.044694:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783142007.044699:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521123072:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783142007.044704:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000040:00080000:0.0:1783142007.045057:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783142007.045540:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1783142007.045558:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783142007.045562:0:14636:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783142007.045565:0:14636:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142007.045575:0:14636:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f9b4414e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142007.045594:0:14636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44155180 x1869759521131776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783142007.045604:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.045607:0:14636:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783142007.045618:0:14636:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142007.045622:0:14636:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:1.0:1783142007.045637:0:14636:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783142007.045642:0:14636:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f9c760a5000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142007.045655:0:14636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44156680 x1869759521131904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783142007.045664:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.045667:0:14636:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783142007.045668:0:14636:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142007.045671:0:14636:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:1.0:1783142007.045674:0:14636:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783142007.045677:0:14636:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142007.045697:0:14636:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b44157480 x1869759521132032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783142007.046166:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783142007.046172:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521122944:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783142007.046200:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521131776:0@lo:38:kworker.0 00000100:00100000:3.0:1783142007.046264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142007.046332:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131776 00000100:00100000:2.0:1783142007.046341:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131776 00000100:00100000:3.0:1783142007.046343:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521131904:0@lo:8:kworker.0 00000100:00100000:2.0:1783142007.046381:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000400:00000100:3.0:1783142007.046384:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521131904 offset 0 length 520: 4 00000100:00100000:2.0:1783142007.046392:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1869759521131776:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783142007.046408:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521132032:0@lo:8:kworker.0 00000400:00000100:3.0:1783142007.046430:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521132032 offset 0 length 520: 4 00010000:00080000:2.0:1783142007.046435:0:17147:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1783142007.046472:0:17147:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a38080b8 00000004:00100000:2.0:1783142007.046488:0:17147:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783142007.046500:0:17147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1783142007.047457:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521132160:0@lo:400:kworker.0 00000100:00100000:0.0:1783142007.047506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142007.047583:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521131648:0@lo:400:kworker.0 00000100:00100000:0.0:1783142007.047613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783142007.048528:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.048533:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142007.048536:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.048539:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142007.048558:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.048560:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142007.048563:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142007.048565:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783142007.048584:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521132288:0@lo:400:kworker.0 00000100:00100000:1.0:1783142007.048648:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142007.048672:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783142007.048678:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521132416:0@lo:400:kworker.0 00000100:00100000:1.0:1783142007.048711:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142007.048777:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521131648 00000100:00100000:2.0:1783142007.048786:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521131648 00000100:00100000:2.0:1783142007.048833:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783142007.048842:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:3653:x1869759521131648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142007.048891:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:3653:x1869759521131648:12345-0@lo:400:kworker.0 Request processed in 50us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142007.048898:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783142007.049630:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521131648:0@lo:400:kworker.0 00000100:00100000:0.0:1783142007.049671:0:17148:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783142007.049690:0:17148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1783142007.049883:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132288 00000100:00100000:2.0:1783142007.049888:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132288 00000100:00100000:0.0:1783142007.050005:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783142007.050013:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142007.050059:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521132288:12345-0@lo:400:kworker.0 Request processed in 47us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142007.050065:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783142007.051186:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9f9c4bd6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142007.051311:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759521131776:12345-0@lo:38:kworker.0 Request processed in 4918us (5044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142007.051330:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783142007.051412:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783142007.051421:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783142007.051425:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783142007.051428:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b4414e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783142007.051449:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ed68a099): req@ffff9f9b44156a00 x1869759521125504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142007.051470:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521131776:0@lo:38:kworker.0 00000100:00100000:0.0:1783142007.051625:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783142007.051636:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521132544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783142007.051670:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142007.051739:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132544 00000100:00100000:2.0:1783142007.051745:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132544 00000100:00100000:2.0:1783142007.051783:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142007.051791:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521132544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783142007.051816:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783142007.051966:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132160 00000100:00100000:3.0:1783142007.051972:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132160 00000100:00100000:2.0:1783142007.051985:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521132544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142007.051994:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783142007.052006:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132416 00000100:00100000:3.0:1783142007.052011:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132416 00000100:00100000:3.0:1783142007.052031:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142007.052035:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521132544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142007.052041:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521132160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142007.052099:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521132160:12345-0@lo:400:kworker.0 Request processed in 60us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142007.052106:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783142007.052119:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783142007.052125:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521132416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142007.052161:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521132416:12345-0@lo:400:kworker.0 Request processed in 36us (3449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142007.052168:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783142007.052185:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b44155f80 x1869759521132160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142007.052198:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521132160:0@lo:400:kworker.0 00000100:00100000:3.0:1783142007.052237:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783142007.052356:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b44156300 x1869759521132416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142007.052367:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521132416:0@lo:400:kworker.0 00000100:00100000:1.0:1783142007.052379:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521132288:0@lo:400:kworker.0 00000100:00100000:3.0:1783142007.052453:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48888300 going to sleep for 11 seconds 00000100:00100000:0.0:1783142007.053871:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521125504 00000100:00100000:0.0:1783142007.053882:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521125504 00000100:00100000:0.0:1783142007.054066:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783142007.054079:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521125504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783142007.054209:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521125504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 133us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142007.054218:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783142007.054346:0:17184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1869759521125504:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783142007.054382:0:17184:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783142007.054424:0:17184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1869759521132672:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783142007.054463:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142007.054497:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915a480 going to sleep for 11 seconds 00000100:00100000:0.0:1783142007.054636:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132672 00000100:00100000:0.0:1783142007.054641:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132672 00000100:00100000:0.0:1783142007.054659:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783142007.054665:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521132672:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783142007.054759:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521132672:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142007.054765:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783142007.054825:0:17184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1869759521132672:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783142007.054883:0:17184:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1869759521132800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783142007.054906:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142007.054926:0:17184:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915a480 going to sleep for 11 seconds 00000100:00100000:0.0:1783142007.055025:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132800 00000100:00100000:0.0:1783142007.055029:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132800 00000100:00100000:0.0:1783142007.055046:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783142007.055051:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521132800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783142007.055100:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17184:x1869759521132800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142007.055105:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783142007.055161:0:17184:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17184:1869759521132800:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783142007.055201:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783142007.057259:0:17184:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783142007.057367:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 12, retries 0 00000004:00080000:1.0:1783142007.057372:0:17184:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783142007.492666:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783142007.816968:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1783142007.876371:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783142007.876379:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9b432c5800 from 8 10000000:01000000:3.0:1783142007.876383:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783142007.876429:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142007.876440:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142007.876450:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142007.876477:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521132928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142007.876547:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142007.876670:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b421c4840 going to sleep for 11 seconds 00000100:00100000:1.0:1783142007.877256:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521132928 00000100:00100000:1.0:1783142007.877263:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521132928 00000100:00100000:1.0:1783142007.877518:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783142007.877528:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17140:x1869759521132928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142007.877544:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142007.877559:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38080bf expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142007.877583:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38080bf expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142007.877594:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080bf expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142007.877603:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168e800, rc 0) 00000100:00100000:1.0:1783142007.877662:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521132928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142007.877670:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783142007.878481:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521132928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142007.878501:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142007.878510:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142007.878570:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783142007.878617:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142007.878668:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b421c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1783142007.878805:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133056 00000100:00100000:2.0:1783142007.878812:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133056 00000100:00100000:2.0:1783142007.878857:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783142007.878866:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521133056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783142007.878884:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783142007.878899:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783142007.878902:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783142007.878984:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521133056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142007.878991:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783142007.879035:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783142007.879072:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783142007.879079:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879087:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783142007.879095:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783142007.879097:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c6f7af000 from 8 10000000:01000000:2.0:1783142007.879100:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783142007.879119:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879135:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879142:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142007.879155:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783142007.879180:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142007.879194:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a970a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783142007.879205:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133184 00000100:00100000:2.0:1783142007.879208:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133184 00000100:00100000:2.0:1783142007.879225:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783142007.879231:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521133184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783142007.879238:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142007.879248:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38080cd expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879261:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38080cd expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879302:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080cd expref: 18 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879310:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1600, rc 0) 00000100:00100000:2.0:1783142007.879338:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521133184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142007.879344:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783142007.879380:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783142007.879392:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879399:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142007.879435:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783142007.879459:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142007.879471:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a970a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783142007.879483:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133312 00000100:00100000:2.0:1783142007.879486:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133312 00000100:00100000:2.0:1783142007.879502:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783142007.879529:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521133312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783142007.879540:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783142007.879559:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783142007.879562:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783142007.879617:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521133312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142007.879623:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783142007.879647:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521133312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783142007.879884:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783142007.879891:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142007.879899:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783142008.068943:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783142008.516418:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142009.540366:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783142010.024588:0:18143:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783142010.564434:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783142010.666731:0:18195:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783142010.666919:0:18195:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783142011.140656:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521133440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783142011.140806:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142011.143048:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133440 00000100:00100000:0.0:1783142011.143063:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133440 00000100:00100000:1.0:1783142011.144833:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783142011.144847:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521133440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783142011.144897:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783142011.144980:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521133440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (4175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142011.144988:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783142011.145057:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521133440:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1783142011.444482:0:18245:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783142011.444892:0:18245:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783142011.588436:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783142012.164410:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142012.164418:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142012.164433:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142012.164436:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142012.164473:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142012.164476:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783142012.164479:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142012.164482:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783142012.164514:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521133568:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.164635:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521134080:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.164685:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783142012.164691:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521133696:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.164742:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521133824:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.164781:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783142012.164786:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521133952:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.164833:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133568 00000100:00100000:1.0:1783142012.164839:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133568 00000100:00100000:1.0:1783142012.164880:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783142012.164888:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:3654:x1869759521133568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.164935:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:3654:x1869759521133568:12345-0@lo:400:kworker.0 Request processed in 47us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.164949:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783142012.164982:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134080 00000100:00100000:1.0:1783142012.164986:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134080 00000100:00100000:1.0:1783142012.165008:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133824 00000100:00100000:1.0:1783142012.165011:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133824 00000100:00100000:1.0:1783142012.165024:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142012.165029:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521134080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165062:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521134080:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.165068:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142012.165081:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783142012.165086:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165114:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521133824:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.165120:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783142012.165138:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133696 00000100:00100000:1.0:1783142012.165141:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133696 00000100:00100000:1.0:1783142012.165162:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521133952 00000100:00100000:1.0:1783142012.165165:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521133952 00000100:00100000:1.0:1783142012.165175:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783142012.165181:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759521133696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165212:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1869759521133696:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.165217:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783142012.165228:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783142012.165234:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521133952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165308:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521133952:12345-0@lo:400:kworker.0 Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.165314:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783142012.165364:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521133952:0@lo:400:kworker.0 00010000:00080000:1.0:1783142012.165377:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b44155180 x1869759521133824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142012.165388:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521133824:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165418:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521133696:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.165426:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521133568:0@lo:400:kworker.0 00010000:00080000:1.0:1783142012.165435:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9c7630b800 x1869759521134080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142012.165444:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521134080:0@lo:400:kworker.0 00000100:00100000:1.0:1783142012.173968:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521134208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783142012.174037:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142012.174126:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134208 00000100:00100000:2.0:1783142012.174133:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134208 00000100:00100000:2.0:1783142012.174182:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783142012.174191:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521134208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783142012.174223:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783142012.174303:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521134208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142012.174311:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783142012.174395:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521134208:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1783142012.341758:0:18294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb70b7df0 20000000:00000080:2.0:1783142012.341776:0:18294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c43519800 uarg=0000000000000000 20000000:01000000:2.0:1783142012.341828:0:18294:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783142012.341835:0:18294:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783142012.341839:0:18294:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783142012.345349:0:18295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783142012.345465:0:18294:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783142012.367027:0:18294:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783142012.367252:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.367385:0:18294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.367395:0:18294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808080 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.367414:0:18294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.367543:0:18294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.368095:0:18294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 17 pid: 17135 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142012.369586:0:18294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18294:1869759521134336:0@lo:104: 00000100:00100000:3.0:1783142012.369660:0:18294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783142012.369742:0:18294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.369752:0:18294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142012.369760:0:18294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18294:1869759521134464:0@lo:104: 00000100:00100000:3.0:1783142012.369781:0:18294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142012.369805:0:18294:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783142012.369907:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134336 00000100:00100000:1.0:1783142012.369923:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134336 00000100:00100000:1.0:1783142012.369979:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134464 00000100:00100000:1.0:1783142012.369983:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134464 00000100:00100000:1.0:1783142012.370002:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783142012.370012:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:18294:x1869759521134336:12345-0@lo:104: 00010000:00010000:1.0:1783142012.370033:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.370163:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783142012.370170:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:18294:x1869759521134336:12345-0@lo:104: Request processed in 160us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.370179:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783142012.370202:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142012.370209:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:18294:x1869759521134464:12345-0@lo:104: 00010000:00010000:1.0:1783142012.370218:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.370265:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783142012.370294:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:18294:x1869759521134464:12345-0@lo:104: Request processed in 63us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.370301:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783142012.370474:0:18294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18294:1869759521134336:0@lo:104: 00000100:00100000:3.0:1783142012.370486:0:18294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18294:1869759521134464:0@lo:104: 00010000:00010000:3.0:1783142012.370533:0:18294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370570:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783142012.370577:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370585:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142012.370590:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370599:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142012.370606:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142012.370612:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142012.370658:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370665:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142012.370700:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370707:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1800/0xb31399d6a3808080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808087 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370724:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142012.370727:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370744:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0c00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142012.370747:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370754:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142012.370760:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142012.370766:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142012.370793:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370800:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142012.370808:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370814:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0c00/0xb31399d6a3807f7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3807f84 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.370831:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142012.370833:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142012.370834:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142012.370851:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142012.371126:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521134592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783142012.371174:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.371224:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783142012.371231:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521134720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783142012.371264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142012.371326:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134592 00000100:00100000:1.0:1783142012.371333:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134592 00010000:00010000:1.0:1783142012.371359:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 18 pid: 17135 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142012.371383:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134720 00000100:00100000:1.0:1783142012.371385:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134720 00010000:00010000:1.0:1783142012.371398:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 19 pid: 17136 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142012.371428:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783142012.371435:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:3652:x1869759521134592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783142012.371449:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783142012.371455:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 19 pid: 17135 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371467:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 19 pid: 17135 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371482:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168e400/0xb31399d6a3808087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3808080 expref: 19 pid: 17135 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371497:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783142012.371540:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:3652:x1869759521134592:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.371548:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783142012.371566:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142012.371573:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:3652:x1869759521134720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783142012.371581:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783142012.371585:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371595:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371605:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3807f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a3807f7d expref: 17 pid: 17136 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371627:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371636:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371653:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371661:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371669:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371675:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371694:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142012.371698:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371706:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371718:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142012.371727:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783142012.371750:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:3652:x1869759521134720:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142012.371762:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142012.371976:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521134720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783142012.371985:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521134592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142012.372151:0:18294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.372160:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.372173:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2400/0xb31399d6a38080db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142012.614744:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783142012.682041:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783142013.639331:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783142013.956341:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783142013.956349:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9b432c5800 from 13 10000000:01000000:1.0:1783142013.956355:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783142013.956399:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.956411:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.956422:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142013.956446:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521134848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783142013.956518:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142013.956624:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49347540 going to sleep for 11 seconds 00000100:00100000:2.0:1783142013.960448:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134848 00000100:00100000:2.0:1783142013.960463:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134848 00000100:00100000:2.0:1783142013.960533:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783142013.960543:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+16:17140:x1869759521134848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783142013.960560:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142013.960580:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38080e2 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142013.960626:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142013.960637:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142013.960643:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0200, rc 0) 00000100:00100000:2.0:1783142013.960723:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521134848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (4205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142013.960731:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783142013.961290:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521134848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142013.961315:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.961325:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142013.961476:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521134976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.961554:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142013.961605:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142013.961658:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521134976 00000100:00100000:1.0:1783142013.961664:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521134976 00000100:00100000:1.0:1783142013.961708:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783142013.961714:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521134976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783142013.961861:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521134976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142013.961868:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783142013.961993:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521134976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.962034:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.962090:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142013.962111:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135104 00000100:00100000:2.0:1783142013.962119:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135104 00000100:00100000:0.0:1783142013.962121:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783142013.962166:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783142013.962176:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521135104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783142013.962331:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521135104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142013.962343:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783142013.962358:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783142013.963428:0:18368:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783142013.963953:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783142013.963996:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783142013.964008:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.964021:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783142013.964032:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783142013.964035:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f7af000 from 13 10000000:01000000:1.0:1783142013.964038:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783142013.964203:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.964213:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142013.964234:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142013.964258:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783142013.964346:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142013.964388:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135232 00000100:00100000:0.0:1783142013.964400:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135232 00000100:00100000:0.0:1783142013.964462:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783142013.964474:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+17:17140:x1869759521135232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142013.964492:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142013.964509:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38080f0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142013.964557:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142013.964569:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142013.964579:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e600, rc 0) 00000100:00100000:0.0:1783142013.964638:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521135232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142013.964646:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783142013.964715:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49347180 going to sleep for 11 seconds 00000100:00100000:0.0:1783142013.964748:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142013.964765:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142013.964776:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142013.964850:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.964882:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142013.964909:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783142013.965058:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135360 00000100:00100000:2.0:1783142013.965067:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135360 00000100:00100000:2.0:1783142013.965125:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783142013.965133:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521135360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783142013.965307:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521135360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142013.965315:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783142013.965464:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.965500:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783142013.965552:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142013.965587:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4705e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783142013.965661:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135488 00000100:00100000:1.0:1783142013.965668:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135488 00000100:00100000:1.0:1783142013.965713:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783142013.965721:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521135488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783142013.965826:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:17140:x1869759521135488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142013.965832:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783142013.966888:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521135488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783142013.968149:0:18369:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783142013.968556:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783142013.968604:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783142013.968619:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142013.968633:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142014.660878:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142015.175362:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142005/real 1783142005] req@ffff9f9b442cb100 x1869759521128064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142015.175402:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b442cb100 x1869759521128064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142015.175411:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142005/real 1783142005] req@ffff9f9b442cad80 x1869759521127936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142015.175420:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b442cad80 x1869759521127936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783142015.175438:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142015.176796:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142015.176815:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521128064:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783142015.176825:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142015.176832:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142015.176835:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521127936:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783142015.177017:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142015.177022:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142015.177025:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142015.177027:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142015.177053:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142015.177056:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783142015.177059:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142015.177064:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1783142015.177069:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783142015.177076:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f9c4b36b800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142015.177097:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e3800 x1869759521136128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783142015.177111:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142015.177114:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783142015.177116:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142015.177119:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1783142015.177129:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783142015.177133:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9b427f3000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142015.177147:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e0a80 x1869759521136256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783142015.177305:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521135616:0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.177368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142015.177412:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521136384:0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.177443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142015.177465:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783142015.177471:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521135744:0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.177494:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142015.177520:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521136128:0@lo:8:kworker.0 00000400:00000100:2.0:1783142015.177541:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521136128 offset 0 length 520: 4 00000100:00100000:2.0:1783142015.177552:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521136256:0@lo:8:kworker.0 00000400:00000100:2.0:1783142015.177657:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759521136256 offset 0 length 520: 4 00000100:00100000:0.0:1783142015.178687:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135616 00000100:00100000:0.0:1783142015.178697:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135616 00000100:00100000:0.0:1783142015.178749:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783142015.178758:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:3654:x1869759521135616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142015.178830:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:3654:x1869759521135616:12345-0@lo:400:kworker.0 Request processed in 72us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142015.178837:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783142015.178985:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521135616:0@lo:400:kworker.0 00000100:00100000:0.0:1783142015.179386:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521136000:0@lo:400:kworker.0 00000100:00100000:0.0:1783142015.179423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142015.179455:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783142015.179463:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521135872:0@lo:400:kworker.0 00000100:00100000:0.0:1783142015.179487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142015.179551:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135744 00000100:00100000:2.0:1783142015.179556:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135744 00000100:00100000:2.0:1783142015.179604:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136000 00000100:00100000:2.0:1783142015.179607:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136000 00000100:00100000:2.0:1783142015.179623:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783142015.179630:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521135744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.179678:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521135744:12345-0@lo:400:kworker.0 Request processed in 48us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142015.179685:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783142015.179699:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783142015.179705:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521136000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.179738:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521136000:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142015.179744:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783142015.179791:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521136000:0@lo:400:kworker.0 00000100:00100000:2.0:1783142015.180235:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521135744:0@lo:400:kworker.0 00000100:00100000:1.0:1783142015.181062:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136384 00000100:00100000:1.0:1783142015.181069:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136384 00000100:00100000:1.0:1783142015.181115:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521135872 00000100:00100000:1.0:1783142015.181119:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521135872 00000100:00100000:1.0:1783142015.181136:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783142015.181143:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521136384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142015.181238:0:17142:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783142015.181247:0:17142:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783142015.181363:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783142015.181370:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521135872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142015.181576:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521136384:12345-0@lo:400:kworker.0 Request processed in 424us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142015.181583:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783142015.181722:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b441e1880 x1869759521136384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142015.181736:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521136384:0@lo:400:kworker.0 00000100:00100000:3.0:1783142015.184091:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521135872:12345-0@lo:400:kworker.0 Request processed in 2714us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142015.184104:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783142015.184389:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b441e1f80 x1869759521135872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142015.184403:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521135872:0@lo:400:kworker.0 00010000:00010000:2.0:1783142015.685415:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142016.260578:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783142016.260602:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521136512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783142016.260677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142016.260862:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136512 00000100:00100000:2.0:1783142016.260871:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136512 00000100:00100000:2.0:1783142016.260924:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783142016.260940:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521136512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783142016.260976:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783142016.261028:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521136512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142016.261036:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783142016.261078:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521136512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783142016.708520:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783142017.029037:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783142017.288493:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521136640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783142017.288559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142017.288748:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136640 00000100:00100000:1.0:1783142017.288756:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136640 00000100:00100000:1.0:1783142017.288809:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783142017.288818:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521136640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783142017.288851:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783142017.288898:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521136640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142017.288905:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783142017.289177:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521136640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783142017.733720:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783142017.957580:0:18643:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783142017.957584:0:18643:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783142017.957586:0:18643:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783142017.957705:0:18643:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9c79bae000 00000020:01000004:1.0:1783142017.957721:0:18643:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783142017.957734:0:18643:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783142017.957748:0:18643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f9c6ccd8000) 00000020:00000080:1.0:1783142017.957765:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783142018.011314:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783142018.011792:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783142018.012130:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783142018.012620:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783142018.012909:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783142018.013302:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783142018.013590:0:18643:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1783142018.017053:0:18643:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783142018.017506:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783142018.017530:0:18643:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783142018.017543:0:18643:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb31399d6a3808105 00000020:01000004:3.0:1783142018.017550:0:18643:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783142018.017569:0:18643:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783142018.017578:0:18643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783142018.017584:0:18643:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783142018.017589:0:18643:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783142018.017601:0:18643:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f9c48c2b380) 00000020:00000080:3.0:1783142018.017612:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783142018.018754:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783142018.018909:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783142018.018917:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783142018.022229:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783142018.022241:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783142018.022739:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783142018.022746:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783142018.025013:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783142018.025406:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783142018.025413:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783142018.026202:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783142018.026210:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783142018.053996:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783142018.055580:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783142018.055588:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783142018.057534:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783142018.057546:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783142018.059009:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783142018.059149:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783142018.061485:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783142018.061628:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783142018.061634:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783142018.062667:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783142018.062676:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783142018.098392:0:18643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783142018.098567:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783142018.098575:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783142018.099607:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783142018.099615:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783142018.100064:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783142018.100091:0:18643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783142018.100097:0:18643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783142018.111716:0:18643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783142018.111758:0:18643:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783142018.111763:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783142018.111764:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783142018.111766:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783142018.111767:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783142018.111768:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783142018.111770:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783142018.111771:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783142018.111773:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783142018.111774:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783142018.111778:0:18643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783142018.111780:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783142018.111781:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783142018.111783:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783142018.111784:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783142018.111785:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783142018.111786:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783142018.111787:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783142018.111788:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783142018.111789:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783142018.111868:0:18643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783142018.111890:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521136768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783142018.112035:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.112160:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783142018.112216:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136768 00000100:00100000:1.0:1783142018.112225:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136768 00000100:00100000:1.0:1783142018.112408:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783142018.112418:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:18643:x1869759521136768:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783142018.112448:0:17136:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783142018.112451:0:17136:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783142018.112455:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783142018.112868:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:18643:x1869759521136768:12345-0@lo:253:mount.lustre.0 Request processed in 450us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.112877:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783142018.113069:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521136768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783142018.113080:0:18643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783142018.113083:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783142018.113084:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783142018.113085:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783142018.113086:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783142018.113087:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783142018.113088:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783142018.113089:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783142018.113091:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783142018.113092:0:18643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783142018.113109:0:18643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c79bae000 from lustre-OST0000 10000000:01000000:2.0:1783142018.113135:0:18643:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783142018.113138:0:18643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783142018.113146:0:18643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9b42300000 local copy 00010000:00010000:2.0:1783142018.113156:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142018.113263:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521136896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142018.113354:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.113394:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.113454:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521136896 00000100:00100000:3.0:1783142018.113459:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521136896 00000100:00100000:3.0:1783142018.113492:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783142018.113500:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:18643:x1869759521136896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.113570:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:18643:x1869759521136896:12345-0@lo:501:mount.lustre.0 Request processed in 71us (216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783142018.113577:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783142018.113659:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521136896:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783142018.113672:0:18643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783142018.113690:0:18643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783142018.113696:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.113704:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783142018.113736:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c79bae000 10000000:01000000:2.0:1783142018.113740:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783142018.113745:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783142018.113747:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783142018.113751:0:18643:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783142018.113754:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783142018.113776:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.113784:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.113793:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142018.113805:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783142018.113844:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.113863:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.113954:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137024 00000100:00100000:3.0:1783142018.113964:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137024 00000100:00100000:1.0:1783142018.113982:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783142018.113990:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+18:18643:x1869759521137024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142018.113999:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142018.114010:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a380811a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808113 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.114031:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a380811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808113 expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.114043:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168fa00/0xb31399d6a380811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808113 expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.114062:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168fa00, rc 0) 00000100:00100000:1.0:1783142018.114091:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137024:12345-0@lo:101:mount.lustre.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.114145:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142018.114156:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380811a expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.114164:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380811a expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783142018.115093:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783142018.115721:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783142018.117741:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000040:00080000:2.0:1783142018.118429:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783142018.118480:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783142018.118494:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783142018.118504:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783142018.118514:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783142018.118525:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783142018.118549:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783142018.118554:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783142018.118715:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142018.118773:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.118997:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140300 going to sleep for 11 seconds 00000100:00100000:1.0:1783142018.119510:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137152 00000100:00100000:1.0:1783142018.119518:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137152 00000100:00100000:1.0:1783142018.119697:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783142018.119707:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142018.119899:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137152:12345-0@lo:501:mount.lustre.0 Request processed in 192us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.119908:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783142018.120087:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142018.120128:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142018.120171:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.120215:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140300 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.120322:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137280 00000100:00100000:3.0:1783142018.120327:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137280 00000100:00100000:3.0:1783142018.120366:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783142018.120372:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783142018.123635:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137280:12345-0@lo:503:mount.lustre.0 Request processed in 3255us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.123660:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783142018.124559:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783142018.125178:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783142018.125291:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142018.125362:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142018.125464:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48140b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783142018.125504:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137408 00000100:00100000:0.0:1783142018.125511:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137408 00000100:00100000:0.0:1783142018.125858:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783142018.125869:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142018.126514:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137408:12345-0@lo:502:mount.lustre.0 Request processed in 644us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142018.126523:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783142018.126607:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142018.127062:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783142018.127095:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783142018.127112:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783142018.127143:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783142018.127161:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783142018.127175:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783142018.127189:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783142018.127217:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783142018.127233:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783142018.127249:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783142018.127262:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783142018.127382:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783142018.127418:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142018.127468:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.127543:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c669330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.127592:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137536 00000100:00100000:2.0:1783142018.127599:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137536 00000100:00100000:2.0:1783142018.127718:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783142018.127728:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142018.127863:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137536:12345-0@lo:502:mount.lustre.0 Request processed in 136us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.127880:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783142018.127996:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783142018.128035:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783142018.128043:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1783142018.128845:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783142018.128854:0:18660:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783142018.128860:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.128862:0:18660:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783142018.128867:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783142018.128882:0:18660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f9c7b6619c0) 00000020:00000080:0.0:1783142018.128903:0:18660:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783142018.128910:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783142018.129047:0:18660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c79bae000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783142018.129056:0:18660:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783142018.129071:0:18660:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb31399d6a3808128 00010000:00010000:0.0:1783142018.133475:0:18660:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1783142018.133991:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1783142018.135698:0:18660:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1783142018.137084:0:18660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783142018.137095:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142018.137102:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137104:0:18660:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783142018.137107:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783142018.137119:0:18660:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1783142018.137121:0:18660:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783142018.137123:0:18660:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783142018.137125:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783142018.137128:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137129:0:18660:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783142018.137132:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142018.137135:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137137:0:18660:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783142018.137140:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783142018.137142:0:18660:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783142018.137144:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142018.137147:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137148:0:18660:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783142018.137150:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142018.137153:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137154:0:18660:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783142018.137157:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783142018.137182:0:18660:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142018.137184:0:18660:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142018.137185:0:18660:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783142018.137188:0:18660:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1783142018.137465:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783142018.137499:0:18643:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783142018.137523:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380811a expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.137542:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1e00/0xb31399d6a3808113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380811a expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142018.137549:0:18643:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c79bae000 from 1 10000000:01000000:3.0:1783142018.137552:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783142018.137584:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.137592:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.137602:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.137623:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142018.137696:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.137737:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c669330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.137877:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137664 00000100:00100000:2.0:1783142018.137885:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137664 00000100:00100000:2.0:1783142018.137936:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783142018.137945:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:18643:x1869759521137664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142018.137958:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142018.137969:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380812f expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.137991:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380812f expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.138000:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380812f expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.138008:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783142018.138046:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521137664:12345-0@lo:101:mount.lustre.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.138053:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783142018.138250:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783142018.138264:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.138309:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783142018.139408:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783142018.139744:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783142018.140152:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783142018.140204:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783142018.140236:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783142018.140243:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783142018.140498:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.140558:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.140654:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933780 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.141828:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137792 00000100:00100000:2.0:1783142018.141838:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137792 00000100:00100000:3.0:1783142018.142233:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783142018.142243:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521137792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.142445:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521137792:12345-0@lo:501:mount.lustre.0 Request processed in 203us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.142454:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783142018.142505:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.142547:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783142018.142589:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.142614:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521137920 00000100:00100000:3.0:1783142018.142618:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521137920 00000100:00100000:2.0:1783142018.143869:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783142018.143883:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521137920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142018.143999:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521137920:12345-0@lo:503:mount.lustre.0 Request processed in 120us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.144007:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783142018.144394:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933780 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.144418:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521137920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783142018.144795:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783142018.144866:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142018.144920:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.144942:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c669330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.144995:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138048 00000100:00100000:2.0:1783142018.145006:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138048 00000100:00100000:2.0:1783142018.145046:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783142018.145052:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521138048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783142018.145143:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521138048:12345-0@lo:502:mount.lustre.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.145150:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783142018.145235:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142018.145447:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783142018.145474:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783142018.145489:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783142018.145517:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783142018.145532:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783142018.145545:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783142018.145557:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783142018.145570:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783142018.145582:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783142018.145593:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783142018.145606:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783142018.145626:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142018.145728:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142018.145793:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4b70c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.145830:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138176 00000100:00100000:3.0:1783142018.145834:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138176 00000100:00100000:3.0:1783142018.145903:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783142018.145911:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521138176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142018.146008:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521138176:12345-0@lo:502:mount.lustre.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.146020:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783142018.146079:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142018.146116:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783142018.146123:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783142018.146862:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142018.146872:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146874:0:18664:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783142018.146880:0:18664:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c79bae000 00000020:00000080:2.0:1783142018.146883:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142018.146890:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142018.146892:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146894:0:18664:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783142018.146896:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142018.146898:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146899:0:18664:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783142018.146902:0:18664:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c79bae000 00000020:00000080:2.0:1783142018.146904:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142018.146956:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142018.146959:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146961:0:18664:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783142018.146963:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142018.146965:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146966:0:18664:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783142018.146970:0:18664:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c79bae000 00000020:00000080:2.0:1783142018.146972:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142018.146990:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142018.146993:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.146995:0:18664:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783142018.146997:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783142018.146999:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.147006:0:18664:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783142018.147010:0:18664:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c79bae000 00000020:00000080:2.0:1783142018.147013:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783142018.147035:0:18664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783142018.147038:0:18664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783142018.147040:0:18664:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783142018.147042:0:18664:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1783142018.147158:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783142018.147186:0:18643:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783142018.147218:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.147229:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142018.147458:0:18643:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783142018.147461:0:18643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c79bae000 10000000:01000000:3.0:1783142018.147464:0:18643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c79bae000 10000000:01000000:3.0:1783142018.147468:0:18643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783142018.147473:0:18643:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c79bae000 from 1 10000000:01000000:3.0:1783142018.147479:0:18643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783142018.147508:0:18643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.147518:0:18643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.147528:0:18643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.147546:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783142018.147595:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.147662:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933600 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.147699:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138304 00000100:00100000:2.0:1783142018.147706:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138304 00000100:00100000:2.0:1783142018.147774:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783142018.147782:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:18643:x1869759521138304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142018.147794:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142018.147807:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0c00/0xb31399d6a3808144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380813d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.147828:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0c00/0xb31399d6a3808144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380813d expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.147839:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0c00/0xb31399d6a3808144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380813d expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142018.147847:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0c00, rc 0) 00000100:00100000:2.0:1783142018.147892:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138304:12345-0@lo:101:mount.lustre.0 Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.147900:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783142018.147974:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783142018.147988:0:18643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808144 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142018.147997:0:18643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808144 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783142018.158945:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783142018.159241:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783142018.159472:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783142018.159498:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783142018.159511:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783142018.159524:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783142018.159538:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783142018.159551:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783142018.159565:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783142018.159578:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783142018.159591:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783142018.159604:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783142018.159618:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783142018.159631:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783142018.159643:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783142018.159656:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783142018.159668:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783142018.159680:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783142018.159692:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783142018.159719:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783142018.159735:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783142018.159748:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783142018.159758:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783142018.159768:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783142018.159780:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783142018.159791:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783142018.159803:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783142018.159816:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783142018.159829:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783142018.159841:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783142018.159853:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783142018.159865:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783142018.159877:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783142018.159890:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783142018.159904:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783142018.159936:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783142018.159951:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783142018.159963:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783142018.159975:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783142018.159994:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783142018.160000:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783142018.160081:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.160142:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.160206:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.160237:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138432 00000100:00100000:2.0:1783142018.160245:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138432 00000100:00100000:2.0:1783142018.160299:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783142018.160309:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142018.160421:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138432:12345-0@lo:501:mount.lustre.0 Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.160435:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783142018.160448:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142018.160479:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783142018.160515:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.160542:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.160620:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138560 00000100:00100000:2.0:1783142018.160626:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138560 00000100:00100000:2.0:1783142018.160755:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783142018.160763:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783142018.160883:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138560:12345-0@lo:503:mount.lustre.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142018.160890:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783142018.161015:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783142018.161767:0:18643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783142018.161845:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142018.161890:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.161922:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783142018.162203:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138688 00000100:00100000:2.0:1783142018.162209:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138688 00000100:00100000:3.0:1783142018.162901:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783142018.162910:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142018.163040:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138688:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.163048:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783142018.163123:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783142018.163431:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783142018.163459:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783142018.163474:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783142018.163488:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783142018.163502:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783142018.163515:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783142018.163528:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783142018.163541:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783142018.163569:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783142018.163581:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783142018.163593:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783142018.163606:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783142018.163619:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783142018.163632:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783142018.163657:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783142018.163671:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783142018.163699:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783142018.163714:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783142018.163728:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783142018.163740:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783142018.163753:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783142018.163765:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783142018.163778:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783142018.163792:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783142018.163802:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783142018.163809:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783142018.163820:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783142018.163826:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783142018.163842:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783142018.163849:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783142018.163855:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783142018.163862:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783142018.163877:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783142018.163885:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783142018.163892:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783142018.163898:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783142018.163905:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783142018.163912:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783142018.163918:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783142018.163925:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783142018.163931:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783142018.163938:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783142018.163944:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783142018.163951:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783142018.163957:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783142018.163963:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783142018.163970:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783142018.163976:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783142018.164016:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142018.164054:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.164427:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138816 00000100:00100000:3.0:1783142018.164434:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138816 00000100:00100000:0.0:1783142018.164453:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c42be1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783142018.164530:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783142018.164580:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142018.164722:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138816:12345-0@lo:502:mount.lustre.0 Request processed in 184us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.164735:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783142018.164758:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783142018.164900:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783142018.165032:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783142018.165060:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142018.165096:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.165121:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783142018.165168:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521138944 00000100:00100000:1.0:1783142018.165173:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521138944 00000100:00100000:1.0:1783142018.165266:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783142018.165295:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142018.165377:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521138944:12345-0@lo:502:mount.lustre.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.165384:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783142018.165471:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521138944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783142018.165515:0:18643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783142018.165522:0:18643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783142018.166154:0:18670:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783142018.166169:0:18670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f9c7b663380) 00000020:00000080:0.0:1783142018.166188:0:18670:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1783142018.166372:0:18670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c79bae000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783142018.166376:0:18670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c79bae000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783142018.166378:0:18670:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c79bae000 3 00010000:00080000:0.0:1783142018.166405:0:18670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b42766800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783142018.169737:0:18670:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1783142018.169836:0:18670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783142018.169882:0:18670:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783142018.169894:0:18670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb31399d6a3808152 00000100:00080000:0.0:1783142018.169904:0:18670:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783142018.169910:0:18670:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f9b42766800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142018.170011:0:18670:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1f80 x1869759521139072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783142018.170083:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521139072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783142018.170146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142018.170246:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139072 00000100:00100000:1.0:1783142018.170253:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139072 00000100:00100000:1.0:1783142018.170301:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783142018.170308:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759521139072:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783142018.170329:0:17143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1783142018.170369:0:17143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb31399d6a3808159 00000004:00100000:1.0:1783142018.170383:0:17143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783142018.170412:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f9b42586000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783142018.170498:0:18670:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783142018.170561:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.170566:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.170568:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.170571:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.170595:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.170599:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.170601:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.170607:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783142018.170651:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521139584:0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.170698:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783142018.170703:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521139200:0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.170749:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521139328:0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.170789:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783142018.170794:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521139456:0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.170843:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139584 00000100:00100000:0.0:1783142018.170847:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139584 00000100:00100000:0.0:1783142018.170866:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139328 00000100:00100000:0.0:1783142018.170868:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139328 00000100:00100000:0.0:1783142018.170878:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783142018.170883:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521139584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170916:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521139584:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142018.170934:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783142018.170947:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783142018.170952:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521139328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142018.170985:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521139328:12345-0@lo:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142018.170991:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783142018.171026:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b441e2300 x1869759521139328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142018.171044:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521139328:0@lo:400:kworker.0 00010000:00080000:0.0:1783142018.171072:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b43555c00 x1869759521139584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142018.171081:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521139584:0@lo:400:kworker.0 00000020:01000004:0.0:1783142018.171357:0:18670:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783142018.171378:0:18670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f9b427f99c0) 00000020:00000080:0.0:1783142018.171393:0:18670:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00010000:00080000:2.0:1783142018.171484:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b441e1f80 x1869759521139072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142018.171486:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1869759521139072:12345-0@lo:38:llog_process_th.0 Request processed in 1174us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.171502:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783142018.171503:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783142018.171512:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783142018.171520:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783142018.171525:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783142018.171528:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b42766800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783142018.171534:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139200 00000100:00100000:2.0:1783142018.171535:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1869759521139072:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1783142018.171537:0:18670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c79bae000 from lustre-OST0000, refs=3 00000100:00100000:1.0:1783142018.171539:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139200 00000020:01000004:0.0:1783142018.171542:0:18670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c79bae000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783142018.171546:0:18670:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c79bae000 3 00000100:00100000:1.0:1783142018.171568:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139456 00000100:00100000:1.0:1783142018.171571:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139456 00010000:00080000:0.0:1783142018.171581:0:18670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9c44216800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.139@tcp at head 00000100:00100000:1.0:1783142018.171584:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783142018.171589:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521139200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142018.171641:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521139200:12345-0@lo:400:kworker.0 Request processed in 51us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.171648:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783142018.171660:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783142018.171665:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521139456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142018.171697:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521139456:12345-0@lo:400:kworker.0 Request processed in 31us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.171702:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783142018.171734:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521139456:0@lo:400:kworker.0 00000100:00100000:2.0:1783142018.172613:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521139200:0@lo:400:kworker.0 00010000:00010000:0.0:1783142018.173891:0:18670:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1783142018.173985:0:18670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783142018.174039:0:18670:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783142018.174051:0:18670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb31399d6a3808167 00000100:00080000:0.0:1783142018.174060:0:18670:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783142018.174065:0:18670:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f9c44216800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142018.174103:0:18670:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43555c00 x1869759521139712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783142018.174169:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759521139712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783142018.174237:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783142018.174320:0:18670:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783142018.174340:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.174344:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.174347:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.174349:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.174357:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.174360:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783142018.174363:0:14636:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142018.174366:0:14636:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783142018.174726:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139712 00000100:00100000:3.0:1783142018.174738:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139712 00000100:00100000:3.0:1783142018.174771:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783142018.174778:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759521139712:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783142018.174803:0:17142:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1783142018.174832:0:17142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb31399d6a380816e 00000004:00100000:3.0:1783142018.174847:0:17142:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783142018.174875:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9f9b43518000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142018.175058:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1869759521139712:12345-0@lo:38:llog_process_th.0 Request processed in 278us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.175065:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783142018.175250:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f9b43555c00 x1869759521139712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142018.175261:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783142018.175302:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783142018.175309:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783142018.175314:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783142018.175316:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c44216800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783142018.175323:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1869759521139712:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783142018.175492:0:18670:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783142018.175999:0:18643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783142018.176028:0:18643:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783142018.176085:0:18643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808144 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142018.176096:0:18643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc3400/0xb31399d6a380813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808144 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783142018.176143:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783142018.176145:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783142018.176147:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783142018.176148:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783142018.176149:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783142018.176150:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783142018.176152:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783142018.176154:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783142018.176155:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783142018.176159:0:18643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783142018.176162:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783142018.176163:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783142018.176164:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783142018.176165:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783142018.176166:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783142018.176167:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783142018.176168:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783142018.176169:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783142018.176170:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783142018.176189:0:18643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783142018.176213:0:18643:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521139840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783142018.176309:0:18643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142018.176345:0:18643:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c7f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783142018.176580:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139840 00000100:00100000:1.0:1783142018.176586:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139840 00000100:00100000:1.0:1783142018.176626:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783142018.176635:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521139840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783142018.176661:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783142018.176674:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783142018.182129:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783142018.182165:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783142018.182419:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:18643:x1869759521139840:12345-0@lo:253:mount.lustre.0 Request processed in 5782us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.182429:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783142018.182912:0:18643:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:18643:1869759521139840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783142018.182931:0:18643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783142018.182935:0:18643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783142018.182937:0:18643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783142018.182938:0:18643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783142018.182940:0:18643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783142018.182942:0:18643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783142018.182943:0:18643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783142018.182945:0:18643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783142018.182947:0:18643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783142018.182949:0:18643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:3.0:1783142018.182955:0:17158:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783142018.182961:0:17158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783142018.182981:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.182997:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183004:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080cd expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183011:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1783142018.183035:0:18643:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783142018.183048:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183063:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 20 pid: 17137 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.183093:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521139968:0@lo:104: 00000100:00100000:3.0:1783142018.183139:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142018.183189:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521139968 00010000:00010000:3.0:1783142018.183192:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183207:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521139968 00010000:00010000:3.0:1783142018.183214:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.183222:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521140096:0@lo:104: 00000100:00100000:3.0:1783142018.183247:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142018.183318:0:17158:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142018.183318:0:17126:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783142018.183328:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140096 00000100:00100000:1.0:1783142018.183337:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140096 00000100:00100000:1.0:1783142018.183358:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783142018.183366:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521139968:12345-0@lo:104: 00010000:00010000:1.0:1783142018.183378:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.183441:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783142018.183448:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521139968:12345-0@lo:104: Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142018.183455:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783142018.183456:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142018.183462:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183470:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783142018.183471:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142018.183476:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183477:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521140096:12345-0@lo:104: 00010000:00010000:1.0:1783142018.183485:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183486:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142018.183494:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142018.183501:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783142018.183520:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783142018.183526:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521140096:12345-0@lo:104: Request processed in 51us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1783142018.183530:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183531:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783142018.183564:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142018.183617:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142018.183639:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183647:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b1400/0xb31399d6a38080cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080d4 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183660:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142018.183662:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142018.183663:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521140224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142018.183665:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142018.183698:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142018.183733:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140224 00000100:00100000:1.0:1783142018.183737:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140224 00000100:00100000:3.0:1783142018.183752:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521139968:0@lo:104: 00010000:00010000:1.0:1783142018.183756:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 21 pid: 17137 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.183760:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521140096:0@lo:104: 00010000:00010000:3.0:1783142018.183774:0:17158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183777:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783142018.183783:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3653:x1869759521140224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783142018.183799:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783142018.183807:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 21 pid: 17137 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.183817:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 21 pid: 17137 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.183831:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1600/0xb31399d6a38080d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38080cd expref: 21 pid: 17137 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142018.183843:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783142018.183887:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:3653:x1869759521140224:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (188us total) trans 0 rc 0/0 00010000:00010000:3.0:1783142018.183912:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142018.183912:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783142018.183919:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183925:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2a00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142018.183928:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183936:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142018.183942:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142018.183951:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3653:1869759521140224:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1783142018.183958:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783142018.183977:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.183983:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783142018.184027:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521140352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783142018.184056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783142018.184094:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184101:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a38080bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184113:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142018.184115:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142018.184116:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142018.184140:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140352 00000100:00100000:3.0:1783142018.184143:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140352 00010000:00010000:3.0:1783142018.184156:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142018.184176:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783142018.184182:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c77756c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:3654:x1869759521140352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142018.184216:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142018.184223:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184232:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184244:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168e800/0xb31399d6a38080c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38080bf expref: 20 pid: 17136 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184263:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184296:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783142018.184311:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001350224s 00010000:00010000:3.0:1783142018.184316:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184322:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184329:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184336:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184342:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142018.184345:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184352:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184367:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184376:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142018.184457:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c77756c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:3654:x1869759521140352:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142018.184464:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783142018.184506:0:17158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184512:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184518:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c74cc2600/0xb31399d6a3808175 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142018.184533:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142018.184535:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142018.184619:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521140352:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1783142018.185051:0:18643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783142018.186761:0:18643:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783142018.186768:0:18643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783142018.186799:0:18643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783142018.186826:0:18643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783142018.186842:0:18643:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783142018.186855:0:18643:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1783142018.187800:0:18643:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783142018.190121:0:18643:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1783142018.310347:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783142018.756550:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783142018.907521:0:18723:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783142018.907809:0:18723:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1783142019.525349:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783142019.525357:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9b432c5800 from 9 10000000:01000000:3.0:1783142019.525362:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783142019.525406:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.525418:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.525429:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142019.525452:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142019.525582:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142019.525634:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783142019.526053:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140480 00000100:00100000:1.0:1783142019.526061:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140480 00000100:00100000:1.0:1783142019.526114:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783142019.526123:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+19:17140:x1869759521140480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142019.526136:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142019.526169:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380817c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.526208:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380817c expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.526218:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380817c expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.526227:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168ea00, rc 0) 00000100:00100000:1.0:1783142019.526309:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:17140:x1869759521140480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142019.526317:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783142019.526411:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142019.526439:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.526448:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142019.526502:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783142019.527036:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142019.527077:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783142019.527225:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140608 00000100:00100000:0.0:1783142019.527231:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140608 00000100:00100000:0.0:1783142019.527324:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783142019.527333:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:17140:x1869759521140608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783142019.527351:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783142019.527367:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783142019.527370:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1783142019.527452:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:17140:x1869759521140608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142019.527464:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783142019.527488:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783142019.527980:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783142019.527990:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.527999:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142019.528008:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783142019.528010:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c6f7af000 from 9 10000000:01000000:3.0:1783142019.528013:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783142019.528040:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.528047:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.528055:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142019.528082:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142019.528115:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142019.528154:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783142019.528156:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140736 00000100:00100000:1.0:1783142019.528162:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140736 00000100:00100000:1.0:1783142019.528203:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783142019.528211:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:17140:x1869759521140736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142019.528221:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142019.528232:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380818a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.528250:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380818a expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.528259:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380818a expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142019.528268:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c4168fc00, rc 0) 00000100:00100000:1.0:1783142019.528332:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521140736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142019.528347:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783142019.528426:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142019.528439:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142019.528448:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142019.528490:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783142019.528518:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142019.528547:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3d900 going to sleep for 11 seconds 00000100:00100000:1.0:1783142019.528592:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140864 00000100:00100000:1.0:1783142019.528597:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140864 00000100:00100000:1.0:1783142019.528625:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783142019.528631:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521140864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783142019.528642:0:17137:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783142019.528654:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783142019.528656:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783142019.528726:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521140864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142019.528733:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783142019.528799:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521140864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783142019.528842:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783142019.528848:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142019.528856:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142019.780697:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142020.805075:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142021.380461:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521140992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783142021.380584:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142021.380689:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521140992 00000100:00100000:2.0:1783142021.380697:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521140992 00000100:00100000:2.0:1783142021.380878:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783142021.380888:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521140992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783142021.380921:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783142021.380969:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521140992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142021.380976:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783142021.381107:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521140992:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783142021.836133:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142022.276547:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142007/real 1783142007] req@ffff9f9b44156680 x1869759521131904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.276573:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b44156680 x1869759521131904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.276584:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142007/real 1783142007] req@ffff9f9b44157480 x1869759521132032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.276595:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b44157480 x1869759521132032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783142022.276614:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142022.276635:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142022.276640:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521131904:0@lo:8:kworker.0 00000100:00080000:2.0:1783142022.276654:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142022.276660:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142022.276663:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521132032:0@lo:8:kworker.0 00000100:00080000:2.0:1783142022.276779:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142022.276783:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783142022.276785:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783142022.276801:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:2.0:1783142022.276806:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783142022.276811:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f9c760a5000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783142022.276829:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80dc00 x1869759521141376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783142022.276842:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142022.276845:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783142022.276847:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783142022.276850:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:2.0:1783142022.276852:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783142022.276855:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783142022.276865:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80df80 x1869759521141504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783142022.276895:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142022.276899:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783142022.276902:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142022.276905:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783142022.276945:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521141120:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277054:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521141888:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277077:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277096:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783142022.277102:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521141248:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277140:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521142016:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277200:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521141632:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277220:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277234:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521142144:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277250:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.277264:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783142022.277268:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521141760:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.277306:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.278594:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141120 00000100:00100000:2.0:1783142022.278606:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141120 00000100:00100000:2.0:1783142022.278663:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783142022.278671:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3652:x1869759521141120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.278738:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3652:x1869759521141120:12345-0@lo:400:kworker.0 Request processed in 68us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.278745:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783142022.278786:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141888 00000100:00100000:2.0:1783142022.278799:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141888 00000100:00100000:2.0:1783142022.278833:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142016 00000100:00100000:2.0:1783142022.278837:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142016 00000100:00100000:2.0:1783142022.278865:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141632 00000100:00100000:2.0:1783142022.278869:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141632 00000100:00100000:2.0:1783142022.278881:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142144 00000100:00100000:2.0:1783142022.278883:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142144 00000100:00100000:2.0:1783142022.278899:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783142022.278905:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521141888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.278941:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521141888:12345-0@lo:400:kworker.0 Request processed in 36us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.278947:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783142022.278959:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783142022.278965:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521142016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.278994:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521142016:12345-0@lo:400:kworker.0 Request processed in 30us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.279001:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783142022.279013:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142022.279019:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521141632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279052:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521141632:12345-0@lo:400:kworker.0 Request processed in 34us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.279058:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142022.279070:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783142022.279077:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521142144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279105:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521142144:12345-0@lo:400:kworker.0 Request processed in 30us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.279110:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783142022.279132:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141248 00000100:00100000:2.0:1783142022.279143:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141248 00000100:00100000:2.0:1783142022.279182:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141760 00000100:00100000:2.0:1783142022.279185:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141760 00000100:00100000:2.0:1783142022.279200:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783142022.279205:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521141248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279237:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521141248:12345-0@lo:400:kworker.0 Request processed in 32us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.279242:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783142022.279251:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783142022.279255:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521141760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279318:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521141760:12345-0@lo:400:kworker.0 Request processed in 61us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142022.279324:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783142022.279383:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521141760:0@lo:400:kworker.0 00010000:00080000:2.0:1783142022.279400:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80ed80 x1869759521141632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.279411:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521141632:0@lo:400:kworker.0 00010000:00080000:2.0:1783142022.279420:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80ca80 x1869759521142144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.279427:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521142144:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279458:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521141376:0@lo:8:kworker.0 00000100:00100000:2.0:1783142022.279485:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.279517:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521141504:0@lo:8:kworker.0 00000100:00100000:2.0:1783142022.279538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.279589:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521141248:0@lo:400:kworker.0 00010000:00080000:2.0:1783142022.279601:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80c000 x1869759521142016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.279610:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521142016:0@lo:400:kworker.0 00000100:00100000:2.0:1783142022.279620:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521141120:0@lo:400:kworker.0 00010000:00080000:2.0:1783142022.279630:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80e300 x1869759521141888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.279639:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521141888:0@lo:400:kworker.0 00000100:00100000:1.0:1783142022.279661:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141376 00000100:00100000:1.0:1783142022.279667:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141376 00000100:00100000:1.0:1783142022.279690:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521141504 00000100:00100000:1.0:1783142022.279694:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521141504 00000100:00100000:1.0:1783142022.279710:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783142022.279716:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521141376:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783142022.279741:0:18649:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1783142022.279767:0:18649:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a3808198 00002000:00100000:1.0:1783142022.279781:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f9b42587800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783142022.279785:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783142022.279787:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783142022.279950:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783142022.279973:0:18649:0:(import.c:65:import_set_state_nolock()) ffff9f9b42581800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783142022.280024:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759521141376:12345-0@lo:8:kworker.0 Request processed in 307us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142022.280041:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783142022.280059:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783142022.280063:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521141504:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783142022.280075:0:18649:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1783142022.280624:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80dc00 x1869759521141376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783142042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142022.280634:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783142022.280642:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783142022.280649:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783142022.280655:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783142022.280657:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c760a5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783142022.280676:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783142022.280682:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521141376:0@lo:8:kworker.0 00000004:00080000:2.0:1783142022.280731:0:17167:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783142022.280747:0:17167:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17167:1869759521142400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783142022.280777:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.280861:0:17167:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084300 going to sleep for 11 seconds 00000004:00080000:2.0:1783142022.280875:0:17166:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783142022.280944:0:17166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 533347671175ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783142022.280950:0:17166:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1783142022.280967:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783142022.280972:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783142022.280985:0:18648:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783142022.280996:0:18648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783142022.281246:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783142022.281253:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142400 00000100:00100000:2.0:1783142022.281258:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142400 00000100:00080000:2.0:1783142022.281313:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783142022.281324:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521142272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783142022.281358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142022.281673:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142022.281682:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17167:x1869759521142400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783142022.292258:0:18943:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783142022.294491:0:18943:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783142022.294502:0:18943:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1783142022.295812:0:17122:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783142022.302648:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142272 00000100:00100000:1.0:1783142022.302662:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142272 00000100:00100000:1.0:1783142022.302717:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783142022.302728:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521142272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783142022.302758:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783142022.302842:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1869759521142272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (21481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142022.302850:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783142022.302906:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f80dc00 x1869759521142272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783142038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142022.302925:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521142272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783142022.302977:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521141504:12345-0@lo:8:kworker.0 Request processed in 22912us (23438us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783142022.302986:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783142022.303018:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783142022.303036:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783142022.303040:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521141504:0@lo:8:kworker.0 00002000:00010000:3.0:1783142022.330778:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.330792:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.330810:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.330814:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.330821:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.330839:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.330850:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.330858:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.330881:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.331102:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.331111:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331120:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.331124:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331135:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331153:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331161:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f5ef3f/0xb31399d6a380819f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331193:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.331196:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.331198:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.331697:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.331710:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.331720:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.331723:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.331728:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.331741:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.331749:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.331756:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.331779:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.331865:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.331871:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331889:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.331893:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331901:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331913:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331920:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff471af3/0xb31399d6a38081a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.331934:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.331936:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.331939:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.332261:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.332268:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332296:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.332299:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.332304:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332313:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332327:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332334:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332358:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.332637:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.332642:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.332650:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.332654:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.332662:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.332692:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.332698:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332706:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.332709:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.332713:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332720:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332727:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332733:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.332758:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142022.333196:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.333204:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333208:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333217:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1783142022.333220:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085387ac/0xb31399d6a38081ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333222:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.333231:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333243:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333245:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.333252:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333256:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333265:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142022.333291:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333293:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333312:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333318:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.333323:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333332:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163079c0/0xb31399d6a38081b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333347:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.333350:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333363:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc3600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.333367:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333374:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333386:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333393:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000587eadb/0xb31399d6a38081bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333407:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.333408:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.333410:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.333417:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.333421:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.333688:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.333694:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333703:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.333712:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.333717:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333726:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333732:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333738:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.333757:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.333815:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.333821:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333829:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.333833:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.333850:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.334189:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.334196:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334204:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.334206:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.334210:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334219:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334228:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334241:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334263:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334264:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.334302:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028352e1e/0xb31399d6a38081c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334320:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.334323:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334328:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82156000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.334331:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334339:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334350:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334356:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca11120c/0xb31399d6a38081c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334382:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.334384:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.334386:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.334392:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.334592:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.334598:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334606:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.334669:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.334675:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334685:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334693:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334701:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.334722:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.334743:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.334749:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334757:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82157400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.334760:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334768:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334780:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334788:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7eb980/0xb31399d6a38081d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.334803:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.334805:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.334806:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.335195:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.335202:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335217:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.335220:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.335224:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335234:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335242:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335249:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335266:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.335309:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.335314:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335329:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82157000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.335332:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335339:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335352:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335359:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f196cfe8/0xb31399d6a38081d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335374:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.335376:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.335377:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.335593:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.335599:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335606:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.335658:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.335664:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335674:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335693:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335701:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.335720:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.335738:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.335744:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335752:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82157a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.335756:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335764:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335782:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335790:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce49c82a/0xb31399d6a38081de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.335806:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.335807:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.335809:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.336015:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.336075:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336084:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.336087:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.336091:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336100:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336108:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336115:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336143:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.336199:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.336204:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336211:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82156400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.336215:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336222:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336233:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336240:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002141c49d/0xb31399d6a38081e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336265:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.336267:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.336269:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.336376:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.336382:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336390:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.336393:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.336397:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336406:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336413:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336420:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336439:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.336628:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.336633:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336641:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82157200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.336645:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336652:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336662:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.336725:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783142022.336728:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041349d41/0xb31399d6a38081ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336732:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336746:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=533s v=(0 0) 00010000:00010000:0.0:1783142022.336750:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.336756:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.336760:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336770:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336778:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336785:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.336798:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.336824:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.336829:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336836:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c82156a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.336846:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336867:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336879:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336886:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067f2a481/0xb31399d6a38081f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.336900:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.336901:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.336903:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.336909:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.337153:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.337159:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337177:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.337180:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.337184:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337193:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337201:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337213:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337267:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142022.337518:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.337524:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337532:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.337534:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.337539:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337548:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337555:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.337562:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337684:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142022.337689:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337696:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.337700:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337708:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337720:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337732:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f316b26/0xb31399d6a38081fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337745:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.337748:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337754:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.337757:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337765:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337774:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.337780:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.337782:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.337783:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.337831:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142022.337836:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d554737b/0xb31399d6a3808201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.338298:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.338305:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.338313:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.338316:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.338319:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.338328:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.338337:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.338344:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.338397:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.338403:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.338410:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1c00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.338419:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.338426:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.338437:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.338445:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.338447:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.338449:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.338682:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142022.338687:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d929925/0xb31399d6a3808208 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.339204:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.339211:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.339230:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.339233:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.339237:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.339247:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.339255:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.339262:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.340386:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.340396:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.340420:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.340424:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.340434:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.340451:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.340470:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.340481:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.340483:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.341043:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142022.341051:0:18943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2fe3cc/0xb31399d6a380820f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.341567:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.341575:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341587:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.341591:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.341596:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341632:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341643:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341650:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341669:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.341762:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.341769:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.341778:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.341782:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.341790:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.341804:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.341811:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f9c2308/0xb31399d6a3808216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.341824:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.341826:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.341828:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.341834:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.341984:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.341990:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.341999:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.342003:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.342007:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342016:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342037:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342055:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342077:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142022.342470:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.342477:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342485:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.342488:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.342492:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342501:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342509:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342515:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342528:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783142022.342752:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142022.342758:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342765:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.342776:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342785:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342796:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342802:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009653f631/0xb31399d6a380821d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342818:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.342822:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342828:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.342831:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342838:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342846:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342853:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c445ed8/0xb31399d6a3808224 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.342859:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.342869:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.342878:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.342881:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.342884:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.342885:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.342890:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142022.342891:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142022.342895:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342905:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342913:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342921:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.342945:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.343005:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.343010:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343029:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.343033:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343041:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343052:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343059:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ad37c07/0xb31399d6a380822b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343072:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.343074:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.343076:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.343251:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.343257:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343266:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.343269:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.343294:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343303:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343323:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343330:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343348:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142022.343671:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.343677:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343685:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.343688:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.343692:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343701:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343709:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343717:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.343738:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.343787:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.343793:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343808:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.343812:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343821:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343832:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343839:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ca4fac/0xb31399d6a3808232 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343852:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.343854:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343861:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.343864:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343873:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.343883:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.344058:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.344063:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344072:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.344074:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.344078:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344087:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344094:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344101:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344115:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142022.344443:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.344450:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344459:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.344466:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.344471:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344481:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344488:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344496:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344504:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783142022.344723:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cf5b27/0xb31399d6a3808239 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344743:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142022.344747:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344755:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.344759:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142022.344763:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783142022.344767:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344771:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344784:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344785:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.344791:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.344801:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344801:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cf5bdd5/0xb31399d6a3808240 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344824:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344826:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.344832:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344837:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344840:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.344853:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344855:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.344875:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.344877:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.345037:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345052:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0902392/0xb31399d6a3808247 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345067:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.345070:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345077:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142022.345080:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345087:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345097:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345103:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569d56bd/0xb31399d6a380824e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345124:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345126:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345127:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345137:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345141:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142022.345223:0:18943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142022.345230:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.345237:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1783142022.345240:0:18943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142022.345244:0:18943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.345252:0:18943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.345259:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.345266:0:18943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142022.345299:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142022.345313:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142022.345319:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345326:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0e00 already unused, calling callback (ffffffffc0d7ace0) 00002000:00080000:3.0:1783142022.345331:0:18943:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:0.0:1783142022.345331:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345343:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345354:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345361:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b60af3c/0xb31399d6a3808255 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142022.345376:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345378:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142022.345380:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142022.345425:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17167:x1869759521142400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 63741us (64644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142022.345445:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783142022.345740:0:17167:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17167:1869759521142400:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783142022.345762:0:17167:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783142022.345811:0:17167:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17167:1869759521142528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783142022.345846:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142022.345877:0:17167:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34900 going to sleep for 11 seconds 00000100:00100000:3.0:1783142022.345918:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142528 00000100:00100000:3.0:1783142022.346006:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142528 00000100:00100000:3.0:1783142022.346112:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783142022.346123:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17167:x1869759521142528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783142022.346158:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1783142022.358599:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1783142022.358640:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783142022.359047:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17167:x1869759521142528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12923us (13196us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783142022.359059:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783142022.359191:0:17167:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783142022.359199:0:17167:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17167:1869759521142528:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783142022.359215:0:17167:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1783142022.405709:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521142656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142022.405785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142022.406728:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142656 00000100:00100000:0.0:1783142022.406740:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142656 00000100:00100000:0.0:1783142022.406795:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783142022.406804:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521142656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783142022.406851:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783142022.410198:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521142656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3386us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142022.410213:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783142022.410532:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521142656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783142022.863739:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783142023.608088:0:19014:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783142023.882479:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783142024.471739:0:19066:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783142024.471907:0:19066:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783142024.901383:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783142025.340814:0:19116:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783142025.341081:0:19116:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783142025.925503:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142026.501629:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783142026.501652:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521142784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783142026.501719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142026.501786:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142784 00000100:00100000:2.0:1783142026.501794:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142784 00000100:00100000:2.0:1783142026.501829:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783142026.501838:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521142784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783142026.501870:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783142026.501911:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521142784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142026.501918:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783142026.501958:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521142784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783142026.951179:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783142027.273195:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1783142027.524935:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142027.524941:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783142027.524944:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783142027.524952:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:2.0:1783142027.524957:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783142027.524963:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783142027.524980:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f80dc00 x1869759521143296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783142027.525017:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142027.525021:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783142027.525023:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783142027.525026:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783142027.525059:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521143040:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525117:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525177:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521143680:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525199:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525219:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783142027.525223:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3655:1869759521142912:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525262:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521143552:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525331:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521143168:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525373:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521143808:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525401:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783142027.525406:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521143424:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525431:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521143936:0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525467:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521143296:0@lo:8:kworker.0 00000100:00100000:2.0:1783142027.525484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142027.525507:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143040 00000100:00100000:2.0:1783142027.525513:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143040 00000100:00100000:2.0:1783142027.525555:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143552 00000100:00100000:2.0:1783142027.525557:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143552 00000100:00100000:2.0:1783142027.525571:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783142027.525578:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521143040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525622:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521143040:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525629:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783142027.525641:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783142027.525647:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521143552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525667:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521143552:12345-0@lo:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525673:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783142027.525695:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143680 00000100:00100000:2.0:1783142027.525698:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143680 00000100:00100000:2.0:1783142027.525719:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143808 00000100:00100000:2.0:1783142027.525721:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143808 00000100:00100000:2.0:1783142027.525736:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143424 00000100:00100000:2.0:1783142027.525738:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143424 00000100:00100000:2.0:1783142027.525746:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143936 00000100:00100000:2.0:1783142027.525747:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143936 00000100:00100000:2.0:1783142027.525758:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783142027.525763:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521143680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525791:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521143680:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525796:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783142027.525806:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783142027.525812:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521143808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525836:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521143808:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525842:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783142027.525851:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783142027.525855:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521143424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525874:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521143424:12345-0@lo:400:kworker.0 Request processed in 19us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525879:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783142027.525886:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783142027.525891:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521143936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.525909:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521143936:12345-0@lo:400:kworker.0 Request processed in 18us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.525914:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783142027.525930:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143168 00000100:00100000:2.0:1783142027.525937:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143168 00000100:00100000:2.0:1783142027.525960:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521143296 00000100:00100000:2.0:1783142027.525962:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521143296 00000100:00100000:2.0:1783142027.525973:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783142027.525977:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521143168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142027.526003:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521143168:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142027.526008:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783142027.526017:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783142027.526021:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521143296:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783142027.526038:0:18649:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783142027.532606:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521142912 00000100:00100000:3.0:1783142027.532618:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521142912 00000100:00100000:3.0:1783142027.532669:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783142027.532691:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3655:x1869759521142912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142027.532771:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3655:x1869759521142912:12345-0@lo:400:kworker.0 Request processed in 93us (7524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142027.532779:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783142027.532897:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3655:1869759521142912:0@lo:400:kworker.0 00000100:00100000:3.0:1783142027.532917:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521143552:0@lo:400:kworker.0 00000100:00100000:3.0:1783142027.532928:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521143040:0@lo:400:kworker.0 00010000:00080000:3.0:1783142027.532950:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b44235180 x1869759521143680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142027.532961:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521143680:0@lo:400:kworker.0 00000100:00080000:3.0:1783142027.533001:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783142027.533007:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783142027.533009:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783142027.533030:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b44236d80 x1869759521143424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142027.533039:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521143424:0@lo:400:kworker.0 00010000:00080000:3.0:1783142027.533054:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b44235f80 x1869759521143936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142027.533061:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521143936:0@lo:400:kworker.0 00000100:00100000:3.0:1783142027.533073:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521143168:0@lo:400:kworker.0 00010000:00080000:3.0:1783142027.533087:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b44237100 x1869759521143808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142027.533093:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521143808:0@lo:400:kworker.0 00000100:00100000:3.0:1783142027.533176:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521144064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783142027.533208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142027.533906:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144064 00000100:00100000:1.0:1783142027.533913:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144064 00000100:00100000:1.0:1783142027.533950:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783142027.533958:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521144064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783142027.533993:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783142027.534040:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521144064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142027.534047:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783142027.534081:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521144064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783142027.534620:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521144192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142027.534654:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142027.535654:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144192 00000100:00100000:1.0:1783142027.535661:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144192 00000100:00100000:1.0:1783142027.535775:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783142027.535783:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521144192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783142027.535814:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783142027.539418:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521144192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3626us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142027.539433:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783142027.539584:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521144192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783142027.543191:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521143296:12345-0@lo:8:kworker.0 Request processed in 17159us (17697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783142027.543299:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783142027.544615:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142027.544625:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783142027.544631:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521143296:0@lo:8:kworker.0 00010000:00010000:3.0:1783142027.978921:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783142028.554562:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783142029.003946:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142030.026560:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142030.596370:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142015/real 1783142015] req@ffff9f9b441e3800 x1869759521136128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142030.596401:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b441e3800 x1869759521136128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142030.596411:0:3651:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783142015/real 1783142015] req@ffff9f9b441e0a80 x1869759521136256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142030.596422:0:3651:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f9b441e0a80 x1869759521136256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783142030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783142030.596440:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142030.596474:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142030.596485:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521136128:0@lo:8:kworker.0 00000100:00080000:2.0:1783142030.596492:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142030.596497:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783142030.596501:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521136256:0@lo:8:kworker.0 00000100:00080000:0.0:1783142030.596778:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142030.596782:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783142030.596785:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142030.596790:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1783142030.596799:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783142030.596806:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142030.596825:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43557800 x1869759521144704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783142030.596849:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142030.596852:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783142030.596854:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142030.596857:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1783142030.596860:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783142030.596863:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f9c4b36b800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142030.596872:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43556a00 x1869759521145088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783142030.596880:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142030.596883:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783142030.596885:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142030.596887:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1783142030.596890:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783142030.596892:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9b427f3000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142030.596901:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b43554e00 x1869759521145216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783142030.596949:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521144576:0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.597008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142030.597066:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521145472:0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.597094:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142030.597133:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783142030.597139:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521144832:0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.597162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142030.597178:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521145600:0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.597199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142030.597231:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144576 00000100:00100000:0.0:1783142030.597238:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144576 00000100:00100000:0.0:1783142030.597305:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783142030.597314:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521144576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.597361:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521144576:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142030.597369:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783142030.597390:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145472 00000100:00100000:0.0:1783142030.597394:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145472 00000100:00100000:0.0:1783142030.597418:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144832 00000100:00100000:0.0:1783142030.597421:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144832 00000100:00100000:0.0:1783142030.597432:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145600 00000100:00100000:0.0:1783142030.597434:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145600 00000100:00100000:0.0:1783142030.597447:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783142030.597451:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521145472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597569:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521144320:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.597630:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521144960:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.597673:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783142030.597679:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521144448:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.597721:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521145344:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.597761:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145344 00000100:00100000:2.0:1783142030.597765:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145344 00000100:00100000:2.0:1783142030.597785:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783142030.597791:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521144832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597822:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521144832:12345-0@lo:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.597828:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783142030.597840:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783142030.597845:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521145600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597870:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521145600:12345-0@lo:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.597875:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783142030.597895:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783142030.597901:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521145344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.597933:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521145344:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.597939:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783142030.597956:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144320 00000100:00100000:2.0:1783142030.597959:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144320 00000100:00100000:2.0:1783142030.597985:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783142030.597992:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3652:x1869759521144320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.598020:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3652:x1869759521144320:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.598026:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783142030.598049:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144960 00000100:00100000:2.0:1783142030.598053:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144960 00000100:00100000:2.0:1783142030.598075:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144448 00000100:00100000:2.0:1783142030.598078:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144448 00000100:00100000:2.0:1783142030.598090:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783142030.598095:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521144960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.598137:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521144960:12345-0@lo:400:kworker.0 Request processed in 42us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.598143:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783142030.598154:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783142030.598160:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521144448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.598185:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521144448:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.598190:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783142030.598216:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521144704:0@lo:8:kworker.0 00000100:00100000:2.0:1783142030.598250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.598269:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521145088:0@lo:8:kworker.0 00000100:00100000:2.0:1783142030.598308:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.598325:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521145216:0@lo:8:kworker.0 00000100:00100000:2.0:1783142030.598345:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.598369:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521144704 00000100:00100000:2.0:1783142030.598373:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521144704 00000100:00100000:2.0:1783142030.598384:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145088 00000100:00100000:2.0:1783142030.598387:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145088 00000100:00100000:2.0:1783142030.598392:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145216 00000100:00100000:2.0:1783142030.598395:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145216 00000100:00100000:2.0:1783142030.598403:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783142030.598408:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521144704:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783142030.598425:0:18648:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783142030.598454:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521144704:12345-0@lo:8:kworker.0 Request processed in 45us (204us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783142030.598473:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783142030.598485:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783142030.598489:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521145088:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783142030.598503:0:18648:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1783142030.598530:0:18648:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a380825c 00002000:00100000:2.0:1783142030.598543:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f9c6cced000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1783142030.598547:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1783142030.598550:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783142030.598622:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1783142030.598641:0:18648:0:(import.c:65:import_set_state_nolock()) ffff9f9c6ccec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783142030.598679:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759521145088:12345-0@lo:8:kworker.0 Request processed in 188us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142030.598685:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783142030.598696:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783142030.598700:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521145216:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783142030.598709:0:18648:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783142030.598746:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521145216:12345-0@lo:8:kworker.0 Request processed in 44us (400us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783142030.598752:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783142030.598789:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521144448:0@lo:400:kworker.0 00010000:00080000:2.0:1783142030.598802:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b43555180 x1869759521145344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142030.598812:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521145344:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.598821:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521144320:0@lo:400:kworker.0 00000100:00100000:2.0:1783142030.598830:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521144960:0@lo:400:kworker.0 00000100:00080000:2.0:1783142030.598863:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142030.598867:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783142030.598871:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521144704:0@lo:8:kworker.0 00000100:00100000:2.0:1783142030.598880:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783142030.598885:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783142030.598892:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783142030.598896:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783142030.598898:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9c4b36b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783142030.598918:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783142030.598928:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521145088:0@lo:8:kworker.0 00000100:00080000:2.0:1783142030.598940:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142030.598944:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783142030.598947:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521145216:0@lo:8:kworker.0 00000004:00080000:2.0:1783142030.598993:0:17884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783142030.599031:0:17884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521145856:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1783142030.599055:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.599070:0:17884:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783142030.599080:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783142030.599087:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521145728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783142030.599122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.599145:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145856 00000100:00100000:2.0:1783142030.599148:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145856 00000100:00100000:2.0:1783142030.599173:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783142030.599178:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17884:x1869759521145856:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1783142030.599332:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145728 00000100:00100000:1.0:1783142030.599337:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145728 00000100:00100000:1.0:1783142030.599363:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783142030.599369:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1869759521145728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783142030.599386:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000004:00080000:2.0:1783142030.599414:0:17883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783142030.599421:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1869759521145728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142030.599426:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783142030.599462:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521145728:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1783142030.599472:0:17883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 541666200112ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783142030.599478:0:17883:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1783142030.599508:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783142030.599512:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783142030.599514:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783142030.599569:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b43555f80 x1869759521144832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142030.599580:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521144832:0@lo:400:kworker.0 00010000:00080000:1.0:1783142030.599592:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b43555c00 x1869759521145600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142030.599600:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521145600:0@lo:400:kworker.0 00000100:00100000:1.0:1783142030.599614:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521144576:0@lo:400:kworker.0 00000100:00100000:0.0:1783142030.599680:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521145472:12345-0@lo:400:kworker.0 Request processed in 2227us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142030.599688:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1783142030.600185:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b43554380 x1869759521145472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142030.600196:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521145472:0@lo:400:kworker.0 00000004:00080000:2.0:1783142030.607261:0:17875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1783142030.621136:0:18648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1783142030.621147:0:18648:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783142030.621240:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17884:x1869759521145856:12345-0@lo:7:osp-pre-0-1.0 Request processed in 22056us (22179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142030.621251:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783142030.621370:0:17884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521145856:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1783142030.621386:0:17884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783142030.621424:0:17884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521145984:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783142030.621468:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.621497:0:17884:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142030.621649:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521145984 00000100:00100000:1.0:1783142030.621656:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521145984 00000100:00100000:1.0:1783142030.621698:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783142030.621705:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1869759521145984:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1783142030.621729:0:18943:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1783142030.621757:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1869759521145984:12345-0@lo:5:osp-pre-0-1.0 Request processed in 52us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142030.621763:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783142030.621821:0:17884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521145984:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783142030.621830:0:17884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783142030.621864:0:17884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521146112:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783142030.621888:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.621909:0:17884:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142030.621949:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146112 00000100:00100000:1.0:1783142030.621953:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146112 00000100:00100000:1.0:1783142030.621987:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783142030.621993:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17884:x1869759521146112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1783142030.622017:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1783142030.669505:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1783142030.669519:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783142030.669840:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17884:x1869759521146112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47842us (47946us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783142030.669852:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783142030.673530:0:17884:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783142030.673546:0:17884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44236d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17884:1869759521146112:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783142030.673573:0:17884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1783142030.673634:0:17884:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17884:1869759521146240:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783142030.673695:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142030.673721:0:17884:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c49aab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783142030.673836:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146240 00000100:00100000:3.0:1783142030.673842:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146240 00000100:00100000:3.0:1783142030.673897:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783142030.673906:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17884:x1869759521146240:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783142030.673958:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17884:x1869759521146240:12345-0@lo:900:osp-pre-0-1.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142030.673965:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783142030.674137:0:17884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b43556680 x1869759521146240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783142046 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142030.674150:0:17884:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17884:1869759521146240:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1783142031.044555:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142031.620662:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783142031.620686:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521146368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783142031.620766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.620838:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146368 00000100:00100000:1.0:1783142031.620845:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146368 00000100:00100000:1.0:1783142031.621030:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783142031.621040:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521146368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783142031.621071:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783142031.621129:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521146368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142031.621136:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783142031.622832:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521146368:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1783142031.869488:0:19461:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783142031.869492:0:19461:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783142031.869493:0:19461:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783142031.869759:0:19461:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f9c6ccea800 00000020:01000004:2.0:1783142031.869773:0:19461:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783142031.869788:0:19461:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783142031.869801:0:19461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f9b41b199c0) 00000020:00000080:2.0:1783142031.869817:0:19461:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783142031.929070:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783142031.929870:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783142031.930233:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783142031.930541:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783142031.930741:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783142031.930933:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783142031.931136:0:19461:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1783142031.933876:0:19461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783142031.934069:0:19461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783142031.934084:0:19461:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783142031.934106:0:19461:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb31399d6a380826a 00000020:01000004:1.0:1783142031.934113:0:19461:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783142031.934135:0:19461:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783142031.934139:0:19461:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783142031.934145:0:19461:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783142031.934172:0:19461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783142031.934176:0:19461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783142031.953626:0:19461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783142031.953667:0:19461:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1783142031.953671:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783142031.953673:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783142031.953675:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783142031.953676:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783142031.953677:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783142031.953679:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783142031.953680:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783142031.953682:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783142031.953683:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783142031.953687:0:19461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1783142031.953689:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783142031.953690:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783142031.953692:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783142031.953693:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783142031.953694:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783142031.953695:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783142031.953696:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783142031.953697:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783142031.953698:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783142031.953733:0:19461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783142031.953753:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783142031.953819:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.953900:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34000 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.954234:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146496 00000100:00100000:3.0:1783142031.954251:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146496 00000100:00100000:3.0:1783142031.954552:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783142031.954562:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:19461:x1869759521146496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783142031.954594:0:17137:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783142031.954597:0:17137:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783142031.954601:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783142031.954920:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:19461:x1869759521146496:12345-0@lo:253:mount.lustre.0 Request processed in 359us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.954928:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783142031.955000:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783142031.955021:0:19461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783142031.955025:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783142031.955026:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783142031.955027:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783142031.955029:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783142031.955030:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783142031.955031:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783142031.955032:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783142031.955034:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783142031.955035:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783142031.955063:0:19461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f9c6ccea800 from lustre-OST0001 10000000:01000000:1.0:1783142031.955090:0:19461:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783142031.955092:0:19461:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783142031.955110:0:19461:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f9b42300000 local copy 00010000:00010000:1.0:1783142031.955120:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142031.955203:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142031.955234:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.955666:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783142031.955752:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146624 00000100:00100000:2.0:1783142031.955759:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146624 00000100:00100000:2.0:1783142031.955787:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783142031.955795:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:19461:x1869759521146624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142031.955884:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:19461:x1869759521146624:12345-0@lo:501:mount.lustre.0 Request processed in 89us (648us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783142031.955891:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783142031.955981:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146624:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783142031.955995:0:19461:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783142031.956094:0:19461:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783142031.956111:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.956120:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f800/0xb31399d6a3807ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3807ec7 expref: -99 pid: 17121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783142031.956149:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f9c6ccea800 10000000:01000000:1.0:1783142031.956153:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783142031.956158:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783142031.956160:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783142031.956164:0:19461:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783142031.956166:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783142031.956187:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.956194:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.956209:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142031.956223:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783142031.956431:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.956531:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.956636:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146752 00000100:00100000:3.0:1783142031.956641:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146752 00000100:00100000:2.0:1783142031.956724:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783142031.956731:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:19461:x1869759521146752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142031.956742:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142031.956753:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3808278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808271 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.956775:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3808278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808271 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.956785:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0000/0xb31399d6a3808278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808271 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.956793:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0000, rc 0) 00000100:00100000:2.0:1783142031.956833:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521146752:12345-0@lo:101:mount.lustre.0 Request processed in 102us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142031.956840:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783142031.956935:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142031.956947:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808278 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.956956:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808278 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783142031.958053:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783142031.959114:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783142031.959538:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783142031.959787:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783142031.959808:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783142031.959824:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783142031.959839:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783142031.959852:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783142031.959871:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783142031.959886:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783142031.959977:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142031.960035:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142031.960078:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142031.960152:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521146880 00000100:00100000:2.0:1783142031.960158:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521146880 00000100:00100000:2.0:1783142031.960236:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783142031.960251:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521146880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783142031.960670:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521146880:12345-0@lo:501:mount.lustre.0 Request processed in 421us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142031.960677:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783142031.960760:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521146880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142031.960793:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783142031.960831:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142031.960918:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.960980:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147008 00000100:00100000:3.0:1783142031.960986:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147008 00000100:00100000:3.0:1783142031.961013:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783142031.961020:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783142031.961672:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147008:12345-0@lo:503:mount.lustre.0 Request processed in 651us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.961681:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783142031.961775:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783142031.962165:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783142031.962231:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142031.962403:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142031.962477:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142031.962573:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147136 00000100:00100000:2.0:1783142031.962585:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147136 00000100:00100000:3.0:1783142031.962688:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783142031.962697:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142031.963563:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147136:12345-0@lo:502:mount.lustre.0 Request processed in 863us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.963573:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783142031.963724:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783142031.963953:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783142031.963982:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783142031.963996:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783142031.964008:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783142031.964020:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783142031.964033:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783142031.964048:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783142031.964063:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783142031.964075:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1783142031.964116:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142031.964159:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142031.964196:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c433cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.964350:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147264 00000100:00100000:3.0:1783142031.964357:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147264 00000100:00100000:3.0:1783142031.964388:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783142031.964394:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142031.964520:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147264:12345-0@lo:502:mount.lustre.0 Request processed in 125us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.964527:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783142031.964828:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783142031.964883:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1783142031.964892:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783142031.965773:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783142031.965782:0:19465:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783142031.965788:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783142031.965790:0:19465:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783142031.965797:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783142031.965812:0:19465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f9c6ccdcd40) 00000020:00000080:1.0:1783142031.965834:0:19465:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783142031.965840:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783142031.965910:0:19465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6ccea800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783142031.965919:0:19465:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783142031.965926:0:19465:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb31399d6a3808286 00010000:00010000:0.0:1783142031.970343:0:19465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1783142031.970805:0:19465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1783142031.972450:0:19465:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1783142031.973786:0:19465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783142031.973796:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142031.973801:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142031.973802:0:19465:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783142031.973805:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142031.973809:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142031.973810:0:19465:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783142031.973813:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783142031.973815:0:19465:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783142031.973817:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142031.973819:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142031.973820:0:19465:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783142031.973822:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783142031.973824:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142031.973825:0:19465:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783142031.973828:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783142031.973850:0:19465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783142031.973853:0:19465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783142031.973855:0:19465:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783142031.973858:0:19465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783142031.974005:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783142031.974037:0:19461:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783142031.974065:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808278 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.974077:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e800/0xb31399d6a3808271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808278 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783142031.974084:0:19461:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6ccea800 from 1 10000000:01000000:1.0:1783142031.974087:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783142031.974130:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.974138:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.974147:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142031.974169:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783142031.974232:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.974448:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783142031.976974:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147392 00000100:00100000:2.0:1783142031.976984:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147392 00000100:00100000:2.0:1783142031.977044:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783142031.977054:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:19461:x1869759521147392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783142031.977071:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142031.977088:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380828d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.977125:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380828d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.977137:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380828d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142031.977146:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0400, rc 0) 00000100:00100000:2.0:1783142031.977222:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147392:12345-0@lo:101:mount.lustre.0 Request processed in 171us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142031.977230:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783142031.977637:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142031.977655:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.977665:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783142031.978713:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783142031.979107:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783142031.979356:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783142031.979389:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783142031.979408:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783142031.979414:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783142031.979476:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142031.979528:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.979900:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34540 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.983491:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147520 00000100:00100000:3.0:1783142031.983637:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147520 00000100:00100000:3.0:1783142031.983704:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783142031.983714:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783142031.984016:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147520:12345-0@lo:501:mount.lustre.0 Request processed in 294us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.984023:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783142031.984150:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142031.984198:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783142031.984253:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.984308:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34540 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.985172:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147648 00000100:00100000:3.0:1783142031.985180:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147648 00000100:00100000:3.0:1783142031.985219:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783142031.985227:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783142031.986155:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147648:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.986166:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783142031.986313:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147648:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783142031.986707:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783142031.986781:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142031.986829:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.986921:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142031.987088:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147776 00000100:00100000:0.0:1783142031.987103:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147776 00000100:00100000:0.0:1783142031.987147:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783142031.987156:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142031.987374:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147776:12345-0@lo:502:mount.lustre.0 Request processed in 217us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142031.987388:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783142031.987472:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142031.987638:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783142031.987666:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783142031.987681:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783142031.987694:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783142031.987709:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783142031.987723:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783142031.987736:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783142031.987750:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783142031.987763:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783142031.987776:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783142031.987790:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783142031.987828:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142031.987864:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.987939:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783142031.987974:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521147904 00000100:00100000:3.0:1783142031.987980:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521147904 00000100:00100000:3.0:1783142031.988088:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783142031.988106:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783142031.988238:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521147904:12345-0@lo:502:mount.lustre.0 Request processed in 141us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142031.988247:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783142031.988646:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521147904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142031.988693:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783142031.988704:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783142031.989493:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142031.989503:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.989506:0:19469:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783142031.989512:0:19469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6ccea800 00000020:00000080:3.0:1783142031.989515:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783142031.989523:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142031.989526:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.989527:0:19469:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783142031.989529:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142031.989531:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.989532:0:19469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783142031.989536:0:19469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f9c6ccea800 00000020:00000080:3.0:1783142031.989538:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783142031.989631:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142031.989636:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.989637:0:19469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783142031.989648:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142031.989651:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.989653:0:19469:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783142031.989656:0:19469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6ccea800 00000020:00000080:3.0:1783142031.989658:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783142031.992838:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142031.992850:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.992852:0:19469:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783142031.992856:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783142031.992860:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.992862:0:19469:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783142031.992866:0:19469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f9c6ccea800 00000020:00000080:3.0:1783142031.992868:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783142031.992926:0:19469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783142031.992930:0:19469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783142031.992931:0:19469:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783142031.992935:0:19469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1783142031.993931:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783142031.993963:0:19461:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783142031.994083:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.994105:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783142031.994164:0:19461:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783142031.994167:0:19461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f9c6ccea800 10000000:01000000:1.0:1783142031.994170:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f9c6ccea800 10000000:01000000:1.0:1783142031.994174:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783142031.994179:0:19461:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f9c6ccea800 from 1 10000000:01000000:1.0:1783142031.994182:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783142031.994219:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.994228:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.994239:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142031.994262:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783142031.994345:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142031.994389:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142031.994421:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148032 00000100:00100000:0.0:1783142031.994429:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148032 00000100:00100000:0.0:1783142031.994573:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783142031.994583:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:19461:x1869759521148032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783142031.994597:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142031.994609:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407f200/0xb31399d6a38082a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a380829b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142031.994631:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407f200/0xb31399d6a38082a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a380829b expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142031.994653:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407f200/0xb31399d6a38082a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380829b expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142031.994661:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f200, rc 0) 00000100:00100000:0.0:1783142031.994705:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148032:12345-0@lo:101:mount.lustre.0 Request processed in 123us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142031.994711:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783142031.994717:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783142031.994730:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082a2 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142031.994739:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38082a2 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783142032.001571:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1783142032.001870:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783142032.002063:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783142032.002090:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783142032.002126:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783142032.002141:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783142032.002153:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783142032.002166:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783142032.002179:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783142032.002192:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783142032.002203:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783142032.002216:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783142032.002244:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783142032.002259:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783142032.002292:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783142032.002308:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783142032.002322:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783142032.002335:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783142032.002347:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783142032.002360:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783142032.002372:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783142032.002384:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783142032.002420:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783142032.002434:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783142032.002447:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783142032.002460:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783142032.002473:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783142032.002486:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783142032.002511:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783142032.002526:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783142032.002538:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783142032.002549:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783142032.002562:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783142032.002576:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783142032.002589:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783142032.002602:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783142032.002614:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783142032.002625:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783142032.002636:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783142032.002648:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783142032.002661:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1783142032.002672:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1783142032.002683:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1783142032.002697:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1783142032.002724:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1783142032.002739:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1783142032.002749:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1783142032.002759:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1783142032.002777:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1783142032.002783:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1783142032.002861:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142032.002924:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.004041:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148160 00000100:00100000:0.0:1783142032.004050:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148160 00000100:00100000:0.0:1783142032.004119:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783142032.004128:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783142032.008318:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148160:12345-0@lo:501:mount.lustre.0 Request processed in 4181us (5384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.008334:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783142032.009777:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34540 going to sleep for 11 seconds 00000100:00100000:1.0:1783142032.009813:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783142032.009878:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783142032.009940:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142032.009966:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34540 going to sleep for 11 seconds 00000100:00100000:0.0:1783142032.009979:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148288 00000100:00100000:0.0:1783142032.009992:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148288 00000100:00100000:0.0:1783142032.010045:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783142032.010054:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783142032.010181:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148288:12345-0@lo:503:mount.lustre.0 Request processed in 128us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.010187:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783142032.010256:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783142032.010831:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783142032.010896:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142032.010943:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.015043:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148416 00000100:00100000:1.0:1783142032.015056:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142032.015057:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148416 00000100:00100000:0.0:1783142032.015126:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783142032.015135:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142032.015363:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148416:12345-0@lo:502:mount.lustre.0 Request processed in 229us (4420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.015372:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783142032.016174:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142032.016421:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783142032.016456:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783142032.016473:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783142032.016489:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783142032.016501:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783142032.016512:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783142032.016523:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783142032.016537:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783142032.016549:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783142032.016578:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783142032.016593:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783142032.016604:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783142032.016618:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783142032.016631:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783142032.016645:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783142032.016658:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783142032.016670:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783142032.016685:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783142032.016697:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783142032.016722:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783142032.016736:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783142032.016748:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783142032.016761:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783142032.016773:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783142032.016785:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783142032.016811:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783142032.016828:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783142032.016842:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783142032.016856:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783142032.016871:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783142032.016884:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783142032.016896:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783142032.016908:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783142032.016924:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783142032.016936:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783142032.016947:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783142032.016960:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783142032.016975:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783142032.016988:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783142032.017001:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783142032.017015:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783142032.017048:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783142032.017065:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783142032.017077:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1783142032.017089:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1783142032.017120:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1783142032.017135:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1783142032.020695:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1783142032.020789:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142032.020869:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.020922:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148544 00000100:00100000:1.0:1783142032.020927:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142032.020930:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148544 00000100:00100000:0.0:1783142032.020986:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783142032.020996:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142032.021119:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148544:12345-0@lo:502:mount.lustre.0 Request processed in 124us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.021127:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783142032.021211:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142032.021422:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1783142032.021444:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1783142032.021467:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783142032.021516:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142032.021553:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142032.021947:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148672 00000100:00100000:0.0:1783142032.021953:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148672 00000100:00100000:0.0:1783142032.021993:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783142032.022002:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783142032.022107:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521148672:12345-0@lo:502:mount.lustre.0 Request processed in 97us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.022125:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783142032.022216:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521148672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783142032.022291:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1783142032.022304:0:19461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783142032.023814:0:19474:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783142032.023829:0:19474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f9b427fb380) 00000020:00000080:0.0:1783142032.023855:0:19474:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1783142032.024257:0:19474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6ccea800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783142032.024261:0:19474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6ccea800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783142032.024264:0:19474:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6ccea800 3 00010000:00080000:0.0:1783142032.024382:0:19474:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b42103000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783142032.026336:0:19474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1783142032.026840:0:19474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783142032.027036:0:19474:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783142032.027048:0:19474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb31399d6a38082b0 00000100:00080000:0.0:1783142032.027058:0:19474:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783142032.027063:0:19474:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f9b42103000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142032.027104:0:19474:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9b441e1f80 x1869759521148800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783142032.027160:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521148800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783142032.027219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142032.027302:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148800 00000100:00080000:0.0:1783142032.027306:0:19474:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783142032.027308:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148800 00000100:00100000:2.0:1783142032.027340:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783142032.027347:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1869759521148800:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783142032.027351:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142032.027354:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783142032.027356:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142032.027360:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:0.0:1783142032.027362:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783142032.027366:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00010000:00080000:2.0:1783142032.027368:0:17143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000100:00100000:0.0:1783142032.027377:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f764a80 x1869759521149184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1783142032.027396:0:17143:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb31399d6a38082b7 00000004:00100000:2.0:1783142032.027409:0:17143:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783142032.027437:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f9b42766000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783142032.027494:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1869759521148800:12345-0@lo:38:llog_process_th.0 Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.027502:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521149184:0@lo:8:kworker.0 00000100:00100000:2.0:1783142032.027510:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783142032.027528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783142032.027565:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9b441e1f80 x1869759521148800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142032.027575:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783142032.027581:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783142032.027587:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783142032.027591:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783142032.027593:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b42103000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783142032.027599:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1869759521148800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783142032.027695:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149184 00000100:00100000:1.0:1783142032.027700:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149184 00000100:00100000:1.0:1783142032.027727:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783142032.027732:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1869759521149184:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783142032.027870:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1869759521149184:12345-0@lo:8:kworker.0 Request processed in 136us (340us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783142032.027906:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783142032.027910:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783142032.027914:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783142032.027917:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521149184:0@lo:8:kworker.0 00000100:00100000:3.0:1783142032.028006:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521149312:0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.028030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142032.028101:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783142032.028108:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521149440:0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.028131:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783142032.028206:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783142032.028223:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783142032.028225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783142032.028228:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:0.0:1783142032.028231:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783142032.028235:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9b427f3000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142032.028246:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f764700 x1869759521149696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783142032.028293:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521149696:0@lo:8:kworker.0 00000100:00100000:3.0:1783142032.028318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.028390:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521148928:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.028423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.028437:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521149568:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.028452:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.028466:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783142032.028470:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521149056:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.028485:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.028492:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521149824:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.028506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.028530:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149696 00000100:00100000:0.0:1783142032.028533:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149696 00000100:00100000:2.0:1783142032.028839:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149568 00000100:00100000:2.0:1783142032.028844:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149568 00000100:00100000:1.0:1783142032.028855:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783142032.028869:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149056 00000100:00100000:1.0:1783142032.028872:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149056 00000100:00100000:2.0:1783142032.028887:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142032.028894:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521149568:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783142032.028911:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783142032.028942:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783142032.028944:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521149568:12345-0@lo:400:kworker.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.028949:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521149056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142032.028951:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142032.028962:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142032.028966:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521149696:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783142032.028977:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521149056:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.028983:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783142032.029000:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149312 00000100:00100000:2.0:1783142032.029001:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3651:x1869759521149696:12345-0@lo:8:kworker.0 Request processed in 33us (681us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783142032.029003:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149312 00000100:00100000:2.0:1783142032.029006:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142032.029021:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149440 00000100:00100000:2.0:1783142032.029024:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149440 00000100:00100000:0.0:1783142032.029038:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149824 00000100:00100000:2.0:1783142032.029039:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521148928 00000100:00100000:2.0:1783142032.029041:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521148928 00000100:00100000:0.0:1783142032.029044:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149824 00000100:00100000:2.0:1783142032.029052:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783142032.029058:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521149440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.029060:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783142032.029065:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521149312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142032.029088:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521149440:12345-0@lo:400:kworker.0 Request processed in 31us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.029088:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521149312:12345-0@lo:400:kworker.0 Request processed in 23us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142032.029106:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783142032.029118:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783142032.029124:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521148928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.029149:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521149056:0@lo:400:kworker.0 00000100:00100000:2.0:1783142032.029150:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521148928:12345-0@lo:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.029160:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b441e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521148928:0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.029173:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521149568:0@lo:400:kworker.0 00000100:00100000:2.0:1783142032.029177:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783142032.029207:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783142032.029212:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783142032.029218:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.029226:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521149952:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.029248:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142032.029258:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521149824:12345-0@lo:400:kworker.0 Request processed in 41us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142032.029264:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783142032.029290:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521149952 00000100:00100000:2.0:1783142032.029294:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521149952 00000100:00100000:2.0:1783142032.029315:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783142032.029316:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f766a00 x1869759521149824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142032.029320:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521149952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.029327:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521149824:0@lo:400:kworker.0 00000100:00100000:2.0:1783142032.029347:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521149952:12345-0@lo:400:kworker.0 Request processed in 27us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142032.029353:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783142032.029371:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521149440:0@lo:400:kworker.0 00000100:00080000:2.0:1783142032.029372:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783142032.029384:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00080000:0.0:1783142032.029386:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f767480 x1869759521149312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783142032.029388:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783142032.029392:0:3651:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783142032.029395:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521149696:0@lo:8:kworker.0 00000100:00100000:0.0:1783142032.029463:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521149312:0@lo:400:kworker.0 00010000:00080000:0.0:1783142032.029488:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f766d80 x1869759521149952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142032.029496:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521149952:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.029502:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783142032.029507:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521150080:0@lo:400:kworker.0 00000100:00100000:0.0:1783142032.029528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142032.029650:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150080 00000100:00100000:3.0:1783142032.029655:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150080 00000100:00080000:2.0:1783142032.029678:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783142032.029687:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783142032.029693:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521150080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142032.029726:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521150080:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.029738:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783142032.029788:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f764380 x1869759521150080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142032.029798:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521150080:0@lo:400:kworker.0 00000020:01000004:0.0:1783142032.032780:0:19474:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783142032.032796:0:19474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f9b427fcd40) 00000020:00000080:0.0:1783142032.032819:0:19474:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783142032.032982:0:19474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f9c6ccea800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783142032.032986:0:19474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f9c6ccea800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783142032.032988:0:19474:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f9c6ccea800 3 00010000:00080000:0.0:1783142032.033017:0:19474:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f9b42106000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783142032.036790:0:19474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783142032.037551:0:19474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783142032.038029:0:19474:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783142032.038042:0:19474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb31399d6a38082c5 00000100:00080000:0.0:1783142032.038053:0:19474:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783142032.038058:0:19474:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f9b42106000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783142032.038090:0:19474:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c6f764380 x1869759521150208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783142032.038128:0:19474:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783142032.038646:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521150208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783142032.038712:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.038810:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150208 00000100:00100000:0.0:1783142032.038817:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150208 00000100:00100000:0.0:1783142032.038854:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783142032.038861:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1869759521150208:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783142032.038885:0:17142:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1783142032.038927:0:17142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb31399d6a38082cc 00000004:00100000:0.0:1783142032.038942:0:17142:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783142032.038969:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9f9b42107000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142032.039013:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1869759521150208:12345-0@lo:38:llog_process_th.0 Request processed in 150us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.039020:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1783142032.039553:0:19474:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783142032.039605:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783142032.039632:0:19461:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783142032.039645:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082a2 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.039663:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c414a2a00/0xb31399d6a380829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082a2 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783142032.039739:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f9c6f764380 x1869759521150208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783142042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142032.039749:0:3651:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783142032.039756:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783142032.039768:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783142032.039772:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783142032.039775:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b42106000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783142032.039781:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1869759521150208:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1783142032.039929:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783142032.039931:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783142032.039932:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783142032.039934:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783142032.039935:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783142032.039936:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783142032.039937:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783142032.039939:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783142032.039940:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783142032.039944:0:19461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783142032.039946:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783142032.039947:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783142032.039948:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783142032.039949:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783142032.039950:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783142032.039952:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783142032.039953:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783142032.039954:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783142032.039955:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783142032.039973:0:19461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783142032.039986:0:19461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521150336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783142032.040028:0:19461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.040056:0:19461:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4bc386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142032.040071:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150336 00000100:00100000:0.0:1783142032.040075:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150336 00000100:00100000:0.0:1783142032.040118:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783142032.040126:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521150336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783142032.040149:0:17136:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783142032.040161:0:17136:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783142032.047560:0:17136:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783142032.047578:0:17136:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783142032.047739:0:17158:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783142032.047744:0:17158:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783142032.047766:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.047784:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380817c expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.047792:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380818a expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.047799:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.047837:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.047851:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 24 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142032.047866:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521150464:0@lo:104: 00000100:00100000:3.0:1783142032.047939:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783142032.047991:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.048000:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 24 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142032.048008:0:17158:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521150592:0@lo:104: 00000100:00100000:2.0:1783142032.048013:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150464 00000100:00100000:2.0:1783142032.048019:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150464 00000100:00100000:3.0:1783142032.048039:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142032.048058:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150592 00000100:00100000:3.0:1783142032.048061:0:17158:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b41084e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783142032.048061:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150592 00000100:00100000:2.0:1783142032.048077:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783142032.048085:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521150464:12345-0@lo:104: 00010000:00010000:2.0:1783142032.048106:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048193:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783142032.048199:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:17158:x1869759521150464:12345-0@lo:104: Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142032.048207:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783142032.048224:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783142032.048231:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521150592:12345-0@lo:104: 00010000:00010000:2.0:1783142032.048238:0:17125:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.048264:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783142032.048292:0:17125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1783142032.048295:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142032.048298:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:17158:x1869759521150592:12345-0@lo:104: Request processed in 68us (258us total) trans 0 rc 0/0 00010000:00010000:0.0:1783142032.048303:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2a00 already unused, calling callback (ffffffffc1373c20) 00000100:00100000:2.0:1783142032.048304:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:00010000:0.0:1783142032.048307:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.048315:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048318:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783142032.048322:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783142032.048323:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783142032.048328:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783142032.048333:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2600 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:2.0:1783142032.048336:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048342:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783142032.048348:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783142032.048352:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783142032.048352:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.048357:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783142032.048363:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048368:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783142032.048375:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048376:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048383:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2600/0xb31399d6a380817c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808183 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.048383:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2a00/0xb31399d6a380818a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808191 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142032.048394:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142032.048448:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521150464:0@lo:104: 00000100:00100000:3.0:1783142032.048457:0:17158:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17158:1869759521150592:0@lo:104: 00010000:00010000:3.0:1783142032.048473:0:17158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142032.048566:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142032.048830:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142032.048831:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142032.048834:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142032.048834:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142032.048846:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521150720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783142032.048927:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.048981:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783142032.048987:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521150848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783142032.049005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142032.049589:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:19461:x1869759521150336:12345-0@lo:253:mount.lustre.0 Request processed in 9461us (9557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142032.049599:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783142032.049835:0:19461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f767480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b0f07033-43f3-43e4-aeca-29a1a105dcc2:19461:1869759521150336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783142032.049848:0:19461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783142032.049851:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783142032.049853:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783142032.049854:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783142032.049863:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783142032.049864:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783142032.049865:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783142032.049867:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783142032.049869:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783142032.049881:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783142032.049893:0:19461:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1783142032.052756:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150720 00000100:00100000:3.0:1783142032.052769:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150720 00010000:00010000:3.0:1783142032.052816:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 24 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142032.052854:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150848 00000100:00100000:3.0:1783142032.052857:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150848 00010000:00010000:3.0:1783142032.052869:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 25 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142032.052893:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783142032.052901:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+25:3654:x1869759521150720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142032.052915:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142032.052920:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 25 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.052931:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 25 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.052948:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168fc00/0xb31399d6a3808191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380818a expref: 25 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.052961:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142032.053024:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3654:x1869759521150720:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.053032:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783142032.053047:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783142032.053054:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:3654:x1869759521150848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142032.053061:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142032.053065:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 23 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053074:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 23 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053084:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c4168ea00/0xb31399d6a3808183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380817c expref: 23 pid: 17136 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053108:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053117:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783142032.053131:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005387827s 00010000:00010000:3.0:1783142032.053136:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053144:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053151:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053178:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053185:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142032.053190:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053198:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053216:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053227:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142032.053251:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:3654:x1869759521150848:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.053258:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1783142032.053298:0:17158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053307:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142032.053314:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b423e0600/0xb31399d6a38082d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142032.053617:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521150848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783142032.053629:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521150720:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1783142032.062838:0:19461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783142032.066897:0:19461:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783142032.066907:0:19461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783142032.066945:0:19461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783142032.067000:0:19461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783142032.067019:0:19461:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783142032.067034:0:19461:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783142032.067985:0:19461:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783142032.068209:0:19461:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783142032.075480:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142032.644593:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521150976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783142032.644759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142032.644826:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521150976 00000100:00100000:3.0:1783142032.644833:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521150976 00000100:00100000:3.0:1783142032.644885:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783142032.644894:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521150976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783142032.644925:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783142032.644972:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521150976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142032.644979:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783142032.645028:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521150976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783142032.645632:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783142032.645720:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521151104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142032.645764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142032.645861:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151104 00000100:00100000:0.0:1783142032.645867:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151104 00000100:00100000:0.0:1783142032.645906:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783142032.645914:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521151104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783142032.645941:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783142032.645979:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521151104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142032.645987:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783142032.646048:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521151104:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1783142032.786705:0:19527:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783142032.786905:0:19527:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783142033.092419:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783142033.924347:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783142033.924358:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9b432c5800 from 10 10000000:01000000:2.0:1783142033.924363:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783142033.924421:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142033.924434:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142033.924445:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142033.924472:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783142033.924550:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142033.924596:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b434d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142033.924731:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151232 00000100:00100000:0.0:1783142033.924739:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151232 00000100:00100000:0.0:1783142033.924913:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783142033.924924:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521151232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142033.924938:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142033.924953:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407e400/0xb31399d6a38082e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38082da expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.924976:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407e400/0xb31399d6a38082e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38082da expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.925005:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407e400/0xb31399d6a38082e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38082da expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.925013:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407e400, rc 0) 00000100:00100000:0.0:1783142033.925062:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521151232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142033.925070:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783142033.925128:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783142033.925144:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082e1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142033.925153:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38082e1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142033.925255:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783142033.925309:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142033.925346:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b434d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783142033.925467:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151360 00000100:00100000:1.0:1783142033.925472:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151360 00000100:00100000:1.0:1783142033.925505:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783142033.925512:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521151360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783142033.925526:0:17136:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783142033.925611:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783142033.925619:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1783142033.925711:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521151360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142033.925718:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783142033.925987:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43556a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783142033.926048:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783142033.926055:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082e1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142033.926073:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9c6f7b0800/0xb31399d6a38082da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082e1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142033.926092:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783142033.926094:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f9c6f7af000 from 10 10000000:01000000:3.0:1783142033.926096:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783142033.926115:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142033.926122:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142033.926130:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142033.926143:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142033.926260:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142033.926866:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151488 00000100:00100000:0.0:1783142033.926872:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151488 00000100:00100000:0.0:1783142033.926917:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783142033.926925:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521151488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142033.926937:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142033.926948:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407f000/0xb31399d6a38082ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a38082e8 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.926968:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407f000/0xb31399d6a38082ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a38082e8 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.926978:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407f000/0xb31399d6a38082ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38082e8 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.926985:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407f000, rc 0) 00000100:00100000:0.0:1783142033.927019:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521151488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142033.927026:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783142033.927297:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c59b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783142033.927426:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142033.927441:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082ef expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142033.927691:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a38082ef expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142033.927760:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783142033.927802:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142033.927842:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48e34300 going to sleep for 11 seconds 00000100:00100000:0.0:1783142033.927928:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151616 00000100:00100000:0.0:1783142033.927934:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151616 00000100:00100000:0.0:1783142033.927979:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783142033.927986:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521151616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783142033.928003:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783142033.928020:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783142033.928023:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783142033.928113:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521151616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142033.928121:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783142033.928155:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521151616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783142033.928227:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783142033.928234:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082ef expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142033.928242:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1800/0xb31399d6a38082e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a38082ef expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142034.116666:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142035.140511:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142035.717134:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521151744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783142035.717207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142035.718115:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151744 00000100:00100000:3.0:1783142035.718126:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151744 00000100:00100000:3.0:1783142035.718238:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783142035.718249:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521151744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783142035.718296:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783142035.718356:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521151744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142035.718363:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783142035.718461:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521151744:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783142035.718515:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783142036.168127:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142036.740479:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521151872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783142036.740541:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142036.743478:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521151872 00000100:00100000:0.0:1783142036.743492:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521151872 00000100:00100000:0.0:1783142036.743545:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783142036.743554:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521151872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783142036.743589:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783142036.743665:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521151872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142036.743677:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783142036.743748:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521151872:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783142037.189434:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783142037.256102:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142037.256108:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783142037.256111:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142037.256123:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f9b41a0f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142037.256158:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c76309f80 x1869759521152384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783142037.256193:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783142037.256203:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783142037.256205:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783142037.256210:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f9b427f3000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783142037.256222:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f9c76309880 x1869759521152896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783142037.256299:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521152000:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256413:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521152640:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256454:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521153280:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256475:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256497:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783142037.256502:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521152128:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256540:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521152768:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256562:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256578:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521153408:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256626:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521152256:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256648:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256663:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521153024:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256696:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521153536:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256744:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783142037.256749:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521152512:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256777:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521153152:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.256792:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256812:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521152384:0@lo:8:kworker.0 00000100:00100000:1.0:1783142037.256833:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256847:0:3651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521152896:0@lo:8:kworker.0 00000100:00100000:1.0:1783142037.256868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.256896:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152000 00000100:00100000:1.0:1783142037.256903:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152000 00000100:00100000:1.0:1783142037.256947:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783142037.256956:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3652:x1869759521152000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257007:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3652:x1869759521152000:12345-0@lo:400:kworker.0 Request processed in 52us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257013:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783142037.257044:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152640 00000100:00100000:1.0:1783142037.257048:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152640 00000100:00100000:1.0:1783142037.257082:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152128 00000100:00100000:1.0:1783142037.257085:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152128 00000100:00100000:1.0:1783142037.257111:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783142037.257116:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521152640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257149:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521152640:12345-0@lo:400:kworker.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257154:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783142037.257165:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783142037.257171:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521152128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257215:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521152128:12345-0@lo:400:kworker.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257221:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783142037.257242:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153280 00000100:00100000:1.0:1783142037.257246:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153280 00000100:00100000:1.0:1783142037.257296:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153408 00000100:00100000:1.0:1783142037.257299:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153408 00000100:00100000:1.0:1783142037.257310:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153024 00000100:00100000:1.0:1783142037.257312:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153024 00000100:00100000:1.0:1783142037.257320:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153536 00000100:00100000:1.0:1783142037.257323:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153536 00000100:00100000:1.0:1783142037.257334:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152512 00000100:00100000:1.0:1783142037.257336:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152512 00000100:00100000:1.0:1783142037.257346:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153152 00000100:00100000:1.0:1783142037.257349:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153152 00000100:00100000:1.0:1783142037.257362:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783142037.257368:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521153280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257397:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1869759521153280:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257403:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783142037.257416:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783142037.257422:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521153408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142037.257433:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152768 00000100:00100000:0.0:1783142037.257437:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152768 00000100:00100000:1.0:1783142037.257454:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521153408:12345-0@lo:400:kworker.0 Request processed in 31us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.257460:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152256 00000100:00100000:1.0:1783142037.257463:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783142037.257464:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152256 00000100:00100000:0.0:1783142037.257485:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152384 00000100:00100000:0.0:1783142037.257488:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152384 00000100:00100000:1.0:1783142037.257489:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783142037.257496:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521152896 00000100:00100000:0.0:1783142037.257500:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521152896 00000100:00100000:1.0:1783142037.257501:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521153024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142037.257513:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783142037.257522:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521152768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257540:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521153024:12345-0@lo:400:kworker.0 Request processed in 42us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257553:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783142037.257572:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783142037.257572:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521152768:12345-0@lo:400:kworker.0 Request processed in 50us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257581:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521153536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142037.257585:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783142037.257603:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783142037.257613:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521152256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257619:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521153536:12345-0@lo:400:kworker.0 Request processed in 39us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257626:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783142037.257641:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783142037.257649:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521152512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142037.257652:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521152256:12345-0@lo:400:kworker.0 Request processed in 40us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.257660:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783142037.257674:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783142037.257680:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1869759521152384:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783142037.257689:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1869759521152512:12345-0@lo:400:kworker.0 Request processed in 40us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257695:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1783142037.257705:0:18648:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000100:00100000:1.0:1783142037.257711:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783142037.257718:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521153152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.257745:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521153152:12345-0@lo:400:kworker.0 Request processed in 28us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.257750:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783142037.257770:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783142037.257775:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1869759521152896:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783142037.257792:0:18943:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1783142037.257811:0:18943:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb31399d6a38082fd 00002000:00100000:1.0:1783142037.257824:0:18943:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f9b427ca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1783142037.257828:0:18943:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1783142037.257831:0:18943:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783142037.258006:0:18943:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1783142037.258035:0:18943:0:(import.c:65:import_set_state_nolock()) ffff9f9b427ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783142037.258087:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1869759521152896:12345-0@lo:8:kworker.0 Request processed in 310us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.258094:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1783142037.258117:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783142037.258121:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783142037.258122:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783142037.258147:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76309880 x1869759521152896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783142062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783142037.258163:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783142037.258170:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783142037.258174:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783142037.258177:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b427f3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783142037.258189:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783142037.258194:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1869759521152896:0@lo:8:kworker.0 00010000:00080000:1.0:1783142037.258226:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76308000 x1869759521152512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258236:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1869759521152512:0@lo:400:kworker.0 00010000:00080000:1.0:1783142037.258246:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76308e00 x1869759521153152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258253:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521153152:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.258263:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521152256:0@lo:400:kworker.0 00010000:00080000:1.0:1783142037.258295:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c7630ad80 x1869759521153024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258304:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521153024:0@lo:400:kworker.0 00010000:00080000:1.0:1783142037.258324:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44156a00 x1869759521153536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258331:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521153536:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.258366:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521152128:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.258377:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521152768:0@lo:400:kworker.0 00010000:00080000:1.0:1783142037.258387:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44156680 x1869759521153408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258396:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521153408:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.258405:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521152000:0@lo:400:kworker.0 00000100:00100000:1.0:1783142037.258414:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521152640:0@lo:400:kworker.0 00010000:00080000:1.0:1783142037.258423:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b44157480 x1869759521153280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.258430:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b44157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1869759521153280:0@lo:400:kworker.0 00000020:00000080:0.0:1783142037.258988:0:18648:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb31399d6a38082f6 00002000:00100000:0.0:1783142037.259002:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f9b42100800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783142037.259006:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783142037.259016:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783142037.259185:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783142037.259209:0:18648:0:(import.c:65:import_set_state_nolock()) ffff9f9b42106800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142037.259407:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1869759521152384:12345-0@lo:8:kworker.0 Request processed in 1587us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.259418:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1783142037.259500:0:17886:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783142037.259525:0:17886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521153792:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1783142037.259560:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142037.259581:0:17886:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c491b2780 going to sleep for 11 seconds 00000004:00080000:0.0:1783142037.259595:0:17885:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783142037.259660:0:17885:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 548326387343ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783142037.259667:0:17885:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1783142037.259712:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c76309f80 x1869759521152384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783142062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783142037.259725:0:3651:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783142037.260785:0:3651:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783142037.260794:0:3651:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783142037.260798:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9f9b41a0f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783142037.260817:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783142037.260836:0:3651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1869759521152384:0@lo:8:kworker.0 00000100:00100000:0.0:1783142037.260872:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521153664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783142037.261023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142037.261088:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153792 00000100:00100000:0.0:1783142037.261098:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153792 00000100:00100000:0.0:1783142037.261291:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783142037.261308:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1869759521153792:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1783142037.261815:0:17169:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1783142037.261830:0:17169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17169:1869759521154048:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783142037.261867:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142037.261886:0:17169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c491b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142037.261907:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153664 00000100:00100000:0.0:1783142037.261912:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153664 00000100:00100000:0.0:1783142037.262213:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783142037.262221:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3655:x1869759521153664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783142037.262243:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783142037.262434:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3655:x1869759521153664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.262443:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783142037.262462:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783142037.262472:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154048 00000100:00100000:0.0:1783142037.262475:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154048 00000100:00100000:0.0:1783142037.262502:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783142037.262508:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17169:x1869759521154048:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783142037.262550:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521153920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783142037.262578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783142037.263544:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783142037.263590:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f766680 x1869759521153664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142037.263591:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521153920 00000100:00100000:0.0:1783142037.263598:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521153920 00000100:00100000:1.0:1783142037.263617:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521153664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783142037.263629:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783142037.263639:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521153920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783142037.263656:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783142037.263704:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1869759521153920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.263721:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783142037.263770:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f764700 x1869759521153920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783142053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142037.263784:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521153920:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783142037.264678:0:17168:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783142037.264760:0:17168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 548331487438ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783142037.264767:0:17168:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:1.0:1783142037.268817:0:18943:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1783142037.268835:0:18943:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783142037.268918:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1869759521153792:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7607us (9353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.268929:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783142037.269112:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765c00 x1869759521153792/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783142053 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142037.269127:0:17886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521153792:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1783142037.269139:0:17886:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783142037.269175:0:17886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521154176:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783142037.269223:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142037.269246:0:17886:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c491b2780 going to sleep for 11 seconds 00000100:00100000:0.0:1783142037.269310:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154176 00000100:00100000:0.0:1783142037.269317:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154176 00000100:00100000:0.0:1783142037.269353:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783142037.269361:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1869759521154176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783142037.269386:0:18649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1783142037.269416:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1869759521154176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.269423:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783142037.269472:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c6f765c00 x1869759521154176/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783142053 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142037.269482:0:17886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521154176:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783142037.269489:0:17886:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783142037.269511:0:17886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521154304:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783142037.269532:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142037.269547:0:17886:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c491b2780 going to sleep for 11 seconds 00000100:00100000:0.0:1783142037.269560:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154304 00000100:00100000:0.0:1783142037.269570:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154304 00000100:00100000:0.0:1783142037.269591:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783142037.269597:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17886:x1869759521154304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783142037.269620:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1783142037.271082:0:18648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783142037.271090:0:18648:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783142037.271095:0:18648:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000001:02000400:2.0:1783142037.275189:0:19817:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:1.0:1783142037.280543:0:17875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1783142037.281229:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.281238:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281256:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.281260:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.281266:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281300:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281312:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281319:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281336:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.281578:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.281584:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281604:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.281608:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281634:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281649:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281656:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c5e281/0xb31399d6a3808304 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281673:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.281675:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.281676:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.281714:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.281720:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281728:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.281731:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.281735:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281743:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281758:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281765:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281779:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.281876:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.281882:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281889:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.281893:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281901:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281912:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281919:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009353f2df/0xb31399d6a380830b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.281931:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.281939:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.281941:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.283961:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.283971:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.283984:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.283988:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.283994:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284005:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284014:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284022:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284039:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783142037.284441:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.284448:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284457:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.284460:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.284465:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284481:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284490:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284496:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.284582:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783142037.285081:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.285088:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.285098:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.285101:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.285106:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.285116:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.285124:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.285143:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.285159:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1783142037.286408:0:17122:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1783142037.286435:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783142037.286444:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286456:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.286460:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286469:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286487:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286494:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de0de6f/0xb31399d6a3808312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286513:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142037.286516:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286529:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.286533:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286541:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286552:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286558:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d93a4299/0xb31399d6a3808319 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286573:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142037.286577:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286584:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.286588:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286596:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286607:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286621:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace943dd/0xb31399d6a3808320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.286637:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.286638:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783142037.286639:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.286642:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.286648:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.286660:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.286664:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.286669:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.286680:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.286689:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.286696:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.286721:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783142037.287595:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142037.287602:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.287612:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.287616:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.287624:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.287638:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.287646:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000982a41f6/0xb31399d6a3808327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.287665:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.287666:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.287668:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.290171:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.290186:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290216:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.290221:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.290227:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290243:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290256:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290265:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290303:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.290492:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.290498:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290507:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.290512:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290521:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290550:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290558:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4182a1/0xb31399d6a380832e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.290579:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.290581:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.290583:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.290589:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.291102:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.292012:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.292021:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292033:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.292036:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.292040:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292051:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292071:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292078:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292108:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783142037.292239:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142037.292245:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.292253:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142037.292258:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.292267:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.292309:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.292317:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057db54e7/0xb31399d6a3808335 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.292336:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.292338:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.292340:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783142037.292822:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783142037.292829:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292837:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1783142037.292840:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142037.292844:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292853:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292860:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292868:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.292885:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783142037.293137:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142037.293142:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293150:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142037.293154:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293175:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293186:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293193:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000931edee0/0xb31399d6a380833c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293206:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.293207:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.293209:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142037.293366:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.293372:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293380:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.293382:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.293386:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293395:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293403:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293417:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.293786:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142037.294291:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.294298:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.294309:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.294313:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.294317:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.294326:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.294334:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.294342:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.299090:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142037.299102:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.299116:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.299121:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.299132:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.299152:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.299159:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2fe3cc/0xb31399d6a3808343 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.299316:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.299322:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.299329:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.299339:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.299346:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.299357:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.299365:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.299367:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.299369:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.303641:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.303654:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a380834a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.306468:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142037.308388:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.308402:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.308419:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.308424:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.308430:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.308444:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.308454:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.308462:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.308485:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783142037.308854:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783142037.308861:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.308870:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0c00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783142037.308875:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.308884:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.308906:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.308913:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068bb81f6/0xb31399d6a3808351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.308932:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.308934:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.308936:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783142037.309232:0:19462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00002000:00010000:3.0:1783142037.309388:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.309395:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.309405:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.309408:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.309421:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.309431:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.309440:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.309448:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783142037.309524:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783142037.309531:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783142037.309749:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17886:x1869759521154304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40147us (40212us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783142037.309765:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783142037.309828:0:17886:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783142037.309837:0:17886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f765c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17886:1869759521154304:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1783142037.309851:0:17886:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1783142037.309896:0:17886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1869759521154432:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783142037.309928:0:17886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142037.309949:0:17886:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b434d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783142037.309971:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154432 00000100:00100000:2.0:1783142037.309977:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154432 00000100:00100000:2.0:1783142037.310014:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783142037.310022:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1869759521154432:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783142037.310076:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1869759521154432:12345-0@lo:900:osp-pre-1-1.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142037.310082:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783142037.310112:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9b43557800 x1869759521154432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783142053 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142037.310122:0:17886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1869759521154432:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1783142037.312116:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783142037.312787:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.312797:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.312815:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.312820:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.312826:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.312841:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.312852:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.312873:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.312957:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783142037.312964:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.312971:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.312976:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.312985:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313003:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313010:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b60af3c/0xb31399d6a3808358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313035:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.313039:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313046:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.313050:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313069:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313081:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.313090:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.313091:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.313093:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.313550:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.313556:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000569d56bd/0xb31399d6a380835f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142037.313950:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.313957:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.313965:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.313968:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.313972:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.313981:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.313989:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.313995:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.317309:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783142037.317323:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.317337:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.317342:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.317354:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.317383:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.317394:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.317396:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142037.317398:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.317584:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.317592:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a3808366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142037.318097:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.318104:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.318115:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.318119:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.318126:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.318137:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.318146:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.318154:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.318647:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783142037.318654:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.318662:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783142037.318666:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.318686:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.318701:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.318710:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.318712:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.318713:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.318837:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.318842:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380836d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.319138:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783142037.319212:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.319218:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.319227:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.319231:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.319236:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.319244:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.319251:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.319258:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.319602:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783142037.321923:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.321937:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.321953:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.321957:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.321963:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.321976:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.321986:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.321994:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.323889:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783142037.323901:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.323913:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0a00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142037.323918:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.323928:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.323948:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.323956:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf5bdd5/0xb31399d6a3808374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324050:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783142037.324074:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783142037.324079:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324086:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783142037.324089:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324097:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324107:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324113:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a380837b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.324126:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.324128:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.324130:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.325619:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783142037.328254:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.328268:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328311:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.328323:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.328330:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328344:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328354:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328362:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328382:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.328789:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.328796:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.328805:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.328809:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.328829:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.328845:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.328853:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa01e242/0xb31399d6a3808382 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.328869:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.328871:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.328873:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783142037.328952:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.328958:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328966:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.328968:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.328972:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328981:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.328988:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329001:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329022:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.329265:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.329287:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.329295:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.329299:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.329307:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.329319:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.329337:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e3b30b/0xb31399d6a3808389 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.329351:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.329353:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.329355:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783142037.329438:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.329444:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329452:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.329455:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.329459:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329467:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329475:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329482:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329590:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783142037.329910:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.329917:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329931:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.329935:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.329938:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329948:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329956:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.329964:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330129:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783142037.330134:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330141:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.330144:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330153:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330164:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330171:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867b1fcf/0xb31399d6a3808390 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330184:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.330187:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330198:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.330201:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330208:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330217:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.330224:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.330226:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.330227:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.334477:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783142037.334490:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ae045d/0xb31399d6a3808397 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142037.335377:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.335388:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.335402:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.335412:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.335418:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.335433:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.335444:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.335452:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.335821:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.335828:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.335837:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.335842:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.335852:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.335870:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.335886:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.335887:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.335889:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.338641:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.338656:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0902392/0xb31399d6a380839e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783142037.339173:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783142037.339181:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.339195:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1783142037.339199:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142037.339205:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.339219:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.339236:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.339244:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.343244:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.343259:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.343286:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0800 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.343291:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.343304:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.343326:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.344623:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783142037.344636:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69c844b/0xb31399d6a38083a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.344739:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783142037.345211:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.345220:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345233:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.345237:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.345243:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345265:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345308:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345316:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345335:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783142037.345569:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142037.345575:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.345583:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b0e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142037.345588:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.345597:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.345612:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.345620:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aad2eda/0xb31399d6a38083ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.345641:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.345643:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.345645:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783142037.345706:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783142037.345712:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345720:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1783142037.345723:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783142037.345727:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345735:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345743:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345761:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142037.345806:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.348162:0:18673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.348171:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.348183:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.348188:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.348209:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.348226:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.348234:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd15423b/0xb31399d6a38083b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.348251:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.348252:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.349604:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783142037.349968:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783142037.349977:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.349998:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1783142037.350002:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142037.350008:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350021:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350030:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350039:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350070:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783142037.350520:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142037.350527:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.350536:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407f600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142037.350541:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.350550:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.350565:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.350584:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049adc609/0xb31399d6a38083ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142037.350601:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.350603:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142037.350605:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142037.350846:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783142037.350918:0:18648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783142037.350924:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350933:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1783142037.350937:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142037.350941:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350951:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350971:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.350979:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142037.351028:0:18648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783142037.351079:0:18648:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1783142037.351168:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17169:x1869759521154048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88656us (89298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142037.351178:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783142037.351323:0:17169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17169:1869759521154048:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783142037.351337:0:17169:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1783142037.351380:0:17169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b4419dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17169:1869759521154560:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783142037.351413:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.351438:0:17169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b434d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1783142037.351489:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154560 00000100:00100000:0.0:1783142037.351496:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154560 00000100:00100000:0.0:1783142037.351543:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783142037.351551:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17169:x1869759521154560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783142037.351584:0:18649:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1783142037.354405:0:17169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b4419dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17169:1869759521154560:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783142037.354422:0:17169:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1783142037.354584:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142037.354593:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.354606:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b4407e000 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:3.0:1783142037.354611:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.354623:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.354643:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142037.354651:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005002c629/0xb31399d6a38083c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142037.354814:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17169:x1869759521154560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2721us (2856us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783142037.354825:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1783142037.356717:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.356722:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783142037.356725:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783142037.509148:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783142037.764418:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521154688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142037.764604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142037.764686:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154688 00000100:00100000:1.0:1783142037.764693:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154688 00000100:00100000:1.0:1783142037.764745:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783142037.764754:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521154688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783142037.764786:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783142037.764833:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521154688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142037.764840:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783142037.764914:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521154688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783142037.765074:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521154816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783142037.765111:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142037.765168:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154816 00000100:00100000:3.0:1783142037.765177:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154816 00000100:00100000:3.0:1783142037.765206:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783142037.765212:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521154816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783142037.765231:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783142037.768540:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521154816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3320us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142037.768555:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783142037.770183:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b43557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521154816:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1783142038.046740:0:19869:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783142038.046963:0:19869:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783142038.215417:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783142038.788959:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1783142038.802253:0:19919:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783142038.803514:0:19919:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783142039.054237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142039.054354:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156608 00000100:00100000:3.0:1783142039.054364:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156608 00000100:00100000:3.0:1783142039.054407:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:3.0:1783142039.054416:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1869759501156608:12345-192.168.203.39@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783142039.054442:0:17137:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9a64d9db-5acd-4599-9ece-63fc5c8d7b53@192.168.203.39@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1783142039.055167:0:17137:0:(genops.c:1406:class_connect()) connect: client 9a64d9db-5acd-4599-9ece-63fc5c8d7b53, cookie 0xb31399d6a38083c8 00000100:00080000:3.0:1783142039.055348:0:17137:0:(import.c:65:import_set_state_nolock()) ffff9f9c4a2f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142039.055415:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+5:2399:x1869759501156608:12345-192.168.203.39@tcp:250:mount.lustre.0 Request processed in 998us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.055425:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:1.0:1783142039.059453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.060953:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156736 00000100:00100000:0.0:1783142039.060966:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156736 00000100:00100000:0.0:1783142039.061041:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:0.0:1783142039.061061:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+5:14899:x1869759501156736:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783142039.061079:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142039.061098:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b4407fa00/0xb31399d6a38083cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9e6 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142039.061140:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b4407fa00/0xb31399d6a38083cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9e6 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142039.061152:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b4407fa00/0xb31399d6a38083cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9e6 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142039.061161:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b4407fa00, rc 0) 00000100:00100000:0.0:1783142039.061224:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+6:14899:x1869759501156736:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 166us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.061232:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:0.0:1783142039.067401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.067508:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156864 00000100:00100000:1.0:1783142039.067518:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156864 00000100:00100000:1.0:1783142039.067576:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1783142039.067586:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+6:14899:x1869759501156864:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783142039.067709:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+6:14899:x1869759501156864:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 124us (317us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783142039.067718:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1783142039.072903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142039.073055:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501156992 00000100:00100000:3.0:1783142039.073064:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501156992 00000100:00100000:3.0:1783142039.073119:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783142039.073128:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+6:14899:x1869759501156992:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783142039.073144:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142039.073160:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b423e1000/0xb31399d6a38083d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116e9ed expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142039.073205:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b423e1000/0xb31399d6a38083d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ed expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142039.073229:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b423e1000/0xb31399d6a38083d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116e9ed expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142039.073238:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e1000, rc 0) 00000100:00100000:3.0:1783142039.073327:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+7:14899:x1869759501156992:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 200us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.073333:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783142039.079802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.080120:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157120 00000100:00100000:0.0:1783142039.080130:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157120 00000100:00100000:0.0:1783142039.080187:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:0.0:1783142039.080198:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+7:14899:x1869759501157120:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783142039.080374:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14899:x1869759501157120:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 177us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.080383:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:0.0:1783142039.082069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.082163:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157248 00000100:00100000:1.0:1783142039.082171:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157248 00000100:00100000:1.0:1783142039.082349:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1783142039.082358:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14899:x1869759501157248:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783142039.082491:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14899:x1869759501157248:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 132us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.082498:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1783142039.087150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142039.089103:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157376 00000100:00100000:3.0:1783142039.089115:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157376 00000100:00100000:3.0:1783142039.089225:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1783142039.089235:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157376:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783142039.089419:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157376:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 183us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.089427:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1783142039.121209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.121675:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157504 00000100:00100000:0.0:1783142039.121685:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157504 00000100:00100000:0.0:1783142039.121794:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:0.0:1783142039.121805:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157504:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783142039.122036:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157504:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 231us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.122063:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:3.0:1783142039.129862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.130249:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157632 00000100:00100000:1.0:1783142039.130258:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157632 00000100:00100000:1.0:1783142039.130337:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1783142039.130347:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157632:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783142039.130733:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14917:x1869759501157632:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 386us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.130742:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:2.0:1783142039.143716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.144330:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157760 00000100:00100000:1.0:1783142039.144341:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157760 00000100:00100000:1.0:1783142039.144450:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:1.0:1783142039.144470:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+8:14899:x1869759501157760:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783142039.144487:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142039.144504:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd4a00/0xb31399d6a38083dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea1e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.144528:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd4a00/0xb31399d6a38083dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea1e expref: 9 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.144558:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd4a00/0xb31399d6a38083dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea1e expref: 9 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.144567:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4a00, rc 0) 00000100:00100000:1.0:1783142039.144628:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+9:14899:x1869759501157760:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 169us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.144635:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783142039.148937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.149644:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501157888 00000100:00100000:0.0:1783142039.149656:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501157888 00000100:00100000:0.0:1783142039.149717:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:0.0:1783142039.149727:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+9:14899:x1869759501157888:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783142039.149753:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783142039.149775:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783142039.149779:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783142039.149782:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783142039.149785:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783142039.149797:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783142039.152444:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+9:14899:x1869759501157888:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 2708us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.152459:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:2.0:1783142039.158142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.159513:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158016 00000100:00100000:1.0:1783142039.159526:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158016 00000100:00100000:1.0:1783142039.159593:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:1.0:1783142039.159618:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+9:14899:x1869759501158016:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783142039.159636:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142039.159653:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea25 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.159681:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.159693:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 10 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142039.159703:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd5000, rc 0) 00000100:00100000:1.0:1783142039.159771:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14899:x1869759501158016:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 155us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.159779:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:1.0:1783142039.162580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.162736:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158144 00000100:00100000:0.0:1783142039.162746:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158144 00000100:00100000:0.0:1783142039.162801:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:0.0:1783142039.162811:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14899:x1869759501158144:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783142039.162967:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14899:x1869759501158144:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.162975:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:0.0:1783142039.166715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142039.166802:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158272 00000100:00100000:3.0:1783142039.166813:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158272 00000100:00100000:3.0:1783142039.166867:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:3.0:1783142039.166877:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14899:x1869759501158272:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783142039.167031:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14899:x1869759501158272:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 155us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.167040:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:2.0:1783142039.171926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.172183:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158400 00000100:00100000:1.0:1783142039.172193:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158400 00000100:00100000:1.0:1783142039.172251:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:1.0:1783142039.172261:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14920:x1869759501158400:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783142039.172450:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14920:x1869759501158400:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 190us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.172459:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:1.0:1783142039.181211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.181309:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158528 00000100:00100000:0.0:1783142039.181319:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158528 00000100:00100000:0.0:1783142039.181368:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:0.0:1783142039.181376:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14920:x1869759501158528:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783142039.181529:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:14920:x1869759501158528:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 153us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.181546:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:0.0:1783142039.203590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.203684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142039.203933:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158656 00000100:00100000:2.0:1783142039.203942:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158656 00000100:00100000:2.0:1783142039.203983:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158912 00000100:00100000:2.0:1783142039.203986:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158912 00000100:00100000:2.0:1783142039.204009:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783142039.204017:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1869759501158656:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783142039.204054:0:17143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0551ecf9-9ef0-4599-b72d-437ccd3f3832@192.168.203.39@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1783142039.204105:0:17143:0:(genops.c:1406:class_connect()) connect: client 0551ecf9-9ef0-4599-b72d-437ccd3f3832, cookie 0xb31399d6a38083eb 00000004:00100000:2.0:1783142039.204128:0:17143:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783142039.204344:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f9b42760000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783142039.204412:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2399:x1869759501158656:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 393us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142039.204420:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783142039.204439:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1783142039.204456:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1869759501158912:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783142039.204472:0:17143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 0551ecf9-9ef0-4599-b72d-437ccd3f3832@192.168.203.39@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1783142039.204534:0:17143:0:(genops.c:1406:class_connect()) connect: client 0551ecf9-9ef0-4599-b72d-437ccd3f3832, cookie 0xb31399d6a38083f2 00000004:00100000:2.0:1783142039.204546:0:17143:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783142039.204668:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f9b42761000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783142039.204692:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2399:x1869759501158912:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 235us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142039.204699:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1783142039.226965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.227076:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159168 00000100:00100000:0.0:1783142039.227086:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159168 00000100:00100000:0.0:1783142039.227159:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1783142039.227170:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159168:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783142039.227209:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783142039.227332:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159168:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142039.227340:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00080000:1.0:1783142039.227747:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783142039.229331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142039.229352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.229427:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501158784 00000100:00100000:1.0:1783142039.229436:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501158784 00000100:00100000:1.0:1783142039.229491:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159040 00000100:00100000:1.0:1783142039.229500:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159040 00000100:00100000:1.0:1783142039.229531:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1783142039.229538:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:0:x1869759501158784:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783142039.229565:0:18453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783142039.229628:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:0:x1869759501158784:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.229636:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1783142039.229652:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783142039.229659:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:0:x1869759501159040:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783142039.229678:0:18453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783142039.229715:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:0:x1869759501159040:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.229720:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00080000:3.0:1783142039.230014:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783142039.237622:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142039.239799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.239902:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159296 00000100:00100000:1.0:1783142039.239912:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159296 00000100:00100000:1.0:1783142039.239971:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783142039.239982:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159296:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783142039.240069:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159296:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142039.240076:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783142039.247676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.247719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142039.247758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142039.247836:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159424 00000100:00100000:3.0:1783142039.247846:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159424 00000100:00100000:3.0:1783142039.247892:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159552 00000100:00100000:3.0:1783142039.247896:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159552 00000100:00100000:3.0:1783142039.247915:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783142039.247923:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501159424:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783142039.247954:0:18650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0551ecf9-9ef0-4599-b72d-437ccd3f3832@192.168.203.39@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1783142039.247982:0:18650:0:(genops.c:1406:class_connect()) connect: client 0551ecf9-9ef0-4599-b72d-437ccd3f3832, cookie 0xb31399d6a38083f9 00002000:00100000:3.0:1783142039.247994:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0551ecf9-9ef0-4599-b72d-437ccd3f3832/ffff9f9c4a2f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783142039.248010:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783142039.248200:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783142039.248230:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9f9c4a2f1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142039.248318:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2399:x1869759501159424:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 394us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.248326:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783142039.248345:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:3.0:1783142039.248351:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501159552:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783142039.248368:0:18650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0551ecf9-9ef0-4599-b72d-437ccd3f3832@192.168.203.39@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1783142039.248384:0:18650:0:(genops.c:1406:class_connect()) connect: client 0551ecf9-9ef0-4599-b72d-437ccd3f3832, cookie 0xb31399d6a3808400 00002000:00100000:3.0:1783142039.248390:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0551ecf9-9ef0-4599-b72d-437ccd3f3832/ffff9f9c4a2f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783142039.248407:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783142039.248516:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783142039.248535:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9f9c4a2f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783142039.248560:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2399:x1869759501159552:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 207us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.248567:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1783142039.248947:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159680 00000100:00100000:2.0:1783142039.248953:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159680 00000100:00100000:2.0:1783142039.248993:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1783142039.249001:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159680:12345-192.168.203.39@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783142039.249059:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159680:12345-192.168.203.39@tcp:900:mount.lustre.0 Request processed in 59us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142039.249066:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:1.0:1783142039.254363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142039.254560:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159808 00000100:00100000:0.0:1783142039.254570:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159808 00000100:00100000:0.0:1783142039.254627:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783142039.254636:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159808:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783142039.256697:0:17145:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1980us 00000004:00200000:3.0:1783142039.276694:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783142039.276835:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14899:x1869759501159808:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 22193us (22474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142039.276849:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783142039.452679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142039.453171:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501159936 00000100:00100000:2.0:1783142039.453180:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501159936 00000100:00100000:2.0:1783142039.453235:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783142039.453244:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14943:x1869759501159936:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:2.0:1783142039.453263:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142039.453311:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea56 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453389:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453402:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453414:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142039.453462:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783142039.453465:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142039.453800:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453826:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea56 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453842:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea56 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142039.453851:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:2.0:1783142039.453854:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783142039.453857:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1600, rc 0) 00000100:00100000:2.0:1783142039.453918:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:14943:x1869759501159936:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 674us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142039.453925:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00010000:00010000:2.0:1783142040.261692:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142040.836707:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783142040.836729:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521154944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783142040.836802:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142040.838016:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521154944 00000100:00100000:2.0:1783142040.838054:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521154944 00000100:00100000:2.0:1783142040.838330:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783142040.838342:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521154944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783142040.838367:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1783142040.838424:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783142040.838447:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521154944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142040.838456:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783142040.838553:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521154944:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783142041.284533:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142041.285627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.285737:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160064 00000100:00100000:1.0:1783142041.285746:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160064 00000100:00100000:1.0:1783142041.285878:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:1.0:1783142041.285889:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:14995:x1869759501160064:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:1.0:1783142041.285927:0:18453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783142041.286014:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:14995:x1869759501160064:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 127us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.286021:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00080000:3.0:1783142041.287129:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783142041.288778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.288944:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160192 00000100:00100000:0.0:1783142041.288954:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160192 00000100:00080000:3.0:1783142041.289092:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783142041.289133:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:0.0:1783142041.289145:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160192:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:0.0:1783142041.289195:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783142041.289415:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160192:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 273us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.289423:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783142041.298153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.298622:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160320 00000100:00100000:1.0:1783142041.298632:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160320 00000100:00080000:3.0:1783142041.298749:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783142041.298925:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783142041.298938:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160320:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1783142041.298970:0:18652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783142041.299063:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160320:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 128us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.299071:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:3.0:1783142041.303578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.303757:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160448 00000100:00100000:2.0:1783142041.303767:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160448 00000100:00100000:2.0:1783142041.303842:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783142041.303851:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160448:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1783142041.303882:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783142041.303963:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:14995:x1869759501160448:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 113us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.303970:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00080000:3.0:1783142041.304764:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783142041.465946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.468647:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160576 00000100:00100000:1.0:1783142041.468662:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160576 00000100:00100000:1.0:1783142041.468812:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:1.0:1783142041.468823:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+10:15028:x1869759501160576:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783142041.468840:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142041.468856:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd4c00/0xb31399d6a3808415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea5d expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142041.468890:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd4c00/0xb31399d6a3808415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea5d expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142041.468915:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd4c00/0xb31399d6a3808415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea5d expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142041.468924:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4c00, rc 0) 00000100:00100000:1.0:1783142041.468999:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501160576:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 178us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.469007:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:0.0:1783142041.473305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.473396:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160704 00000100:00100000:1.0:1783142041.473405:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160704 00000100:00100000:1.0:1783142041.473459:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:1.0:1783142041.473467:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501160704:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783142041.473632:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501160704:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 164us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.473641:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:3.0:1783142041.477664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.477765:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160832 00000100:00100000:1.0:1783142041.477774:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160832 00000100:00100000:1.0:1783142041.477832:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:1.0:1783142041.477841:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501160832:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783142041.477992:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501160832:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 151us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.478000:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:3.0:1783142041.496530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.496835:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501160960 00000100:00100000:0.0:1783142041.496845:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501160960 00000100:00100000:0.0:1783142041.496907:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:0.0:1783142041.496917:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501160960:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783142041.497074:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501160960:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 157us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.497082:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:0.0:1783142041.519706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.519838:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161088 00000100:00100000:2.0:1783142041.519849:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161088 00000100:00100000:2.0:1783142041.519940:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:2.0:1783142041.519950:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501161088:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783142041.520113:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c525f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501161088:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 164us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.520126:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:2.0:1783142041.529694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.529814:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161216 00000100:00100000:1.0:1783142041.529824:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161216 00000100:00100000:1.0:1783142041.529888:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:1.0:1783142041.529898:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501161216:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783142041.530060:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15034:x1869759501161216:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 163us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.530069:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:3.0:1783142041.534087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.534820:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161344 00000100:00100000:2.0:1783142041.534844:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161344 00000100:00100000:2.0:1783142041.534902:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:2.0:1783142041.534912:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:15028:x1869759501161344:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783142041.534929:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142041.534945:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a380841c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea8e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.534970:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a380841c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea8e expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.534980:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1800/0xb31399d6a380841c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea8e expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.534989:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1800, rc 0) 00000100:00100000:2.0:1783142041.535244:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:15028:x1869759501161344:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 331us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.535251:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:2.0:1783142041.544864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.545086:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161472 00000100:00100000:0.0:1783142041.545096:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161472 00000100:00100000:0.0:1783142041.545210:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:0.0:1783142041.545221:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:15028:x1869759501161472:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783142041.545247:0:17135:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783142041.545301:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783142041.545306:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783142041.545309:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783142041.545312:0:17135:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783142041.545315:0:17135:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1783142041.548392:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:15028:x1869759501161472:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 3162us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.548406:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:3.0:1783142041.551016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.551696:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161600 00000100:00100000:2.0:1783142041.551707:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161600 00000100:00100000:2.0:1783142041.551768:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:2.0:1783142041.551939:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:15028:x1869759501161600:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783142041.551956:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142041.552046:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ea95 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.552076:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.552104:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.552113:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1000, rc 0) 00000100:00100000:2.0:1783142041.552171:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15028:x1869759501161600:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 395us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.552178:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:2.0:1783142041.561795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.566581:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161728 00000100:00100000:0.0:1783142041.566596:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161728 00000100:00100000:0.0:1783142041.566668:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:0.0:1783142041.566677:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15028:x1869759501161728:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783142041.567088:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15028:x1869759501161728:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 411us (5308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.567096:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:3.0:1783142041.569454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.569606:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161856 00000100:00100000:1.0:1783142041.569616:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161856 00000100:00100000:1.0:1783142041.569673:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:1.0:1783142041.569683:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15028:x1869759501161856:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783142041.569827:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15028:x1869759501161856:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.569836:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:3.0:1783142041.572620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.572715:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501161984 00000100:00100000:0.0:1783142041.572724:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501161984 00000100:00100000:0.0:1783142041.572798:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1783142041.572808:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15039:x1869759501161984:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783142041.572946:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15039:x1869759501161984:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 131us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.572954:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1783142041.577378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.577468:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162112 00000100:00100000:2.0:1783142041.577477:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162112 00000100:00100000:2.0:1783142041.577526:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:2.0:1783142041.577536:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15039:x1869759501162112:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783142041.577684:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:15039:x1869759501162112:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 148us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.577693:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:3.0:1783142041.592859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142041.592912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142041.592954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142041.593020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.593064:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162240 00000100:00100000:2.0:1783142041.593065:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163008 00000100:00100000:3.0:1783142041.593066:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162752 00000100:00100000:1.0:1783142041.593075:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162240 00000100:00100000:2.0:1783142041.593076:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163008 00000100:00100000:3.0:1783142041.593085:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162752 00000100:00100000:1.0:1783142041.593122:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162368 00000100:00100000:1.0:1783142041.593126:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162368 00000100:00100000:2.0:1783142041.593133:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:2.0:1783142041.593141:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1869759501163008:12345-192.168.203.39@tcp:38:mount.lustre.0 00000100:00100000:0.0:1783142041.593170:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00010000:00080000:2.0:1783142041.593172:0:17143:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from f535053a-080f-4e4a-b39d-b0db6255876b@192.168.203.39@tcp t0 exp 0000000000000000 cur 552 last 0 00000100:00100000:0.0:1783142041.593180:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1869759501162240:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783142041.593198:0:17144:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f535053a-080f-4e4a-b39d-b0db6255876b@192.168.203.39@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1783142041.593215:0:17143:0:(genops.c:1406:class_connect()) connect: client f535053a-080f-4e4a-b39d-b0db6255876b, cookie 0xb31399d6a380842a 00000100:00100000:1.0:1783142041.593221:0:18453:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000020:00000080:0.0:1783142041.593228:0:17144:0:(genops.c:1406:class_connect()) connect: client f535053a-080f-4e4a-b39d-b0db6255876b, cookie 0xb31399d6a3808431 00000100:00100000:1.0:1783142041.593230:0:18453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000004:00100000:2.0:1783142041.593244:0:17143:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:0.0:1783142041.593248:0:17144:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783142041.593366:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9f9b441a2000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783142041.593373:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f9b435e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142041.593428:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:2399:x1869759501162240:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 249us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.593436:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783142041.593455:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1783142041.593469:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2402:x1869759501162368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783142041.593540:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783142041.593552:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142041.594711:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b441e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f535053a-080f-4e4a-b39d-b0db6255876b+6:2399:x1869759501163008:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 1562us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.594732:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783142041.595301:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2402:x1869759501162368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1828us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.595412:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:2.0:1783142041.597171:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3613us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.597184:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783142041.597871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.597931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.598151:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162624 00000100:00100000:2.0:1783142041.598160:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162624 00000100:00100000:2.0:1783142041.598209:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:2.0:1783142041.598218:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142041.598291:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b4419c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.598297:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:2.0:1783142041.599186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.599223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.599241:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162496 00000100:00100000:2.0:1783142041.599246:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162496 00000100:00100000:2.0:1783142041.599311:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163264 00000100:00100000:2.0:1783142041.599314:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163264 00000100:00100000:2.0:1783142041.599335:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783142041.599342:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+7:0:x1869759501162496:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783142041.599367:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783142041.599413:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+7:0:x1869759501162496:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.599422:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783142041.599436:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:2.0:1783142041.599442:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163264:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783142041.599467:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783142041.599558:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501162880 00000100:00100000:3.0:1783142041.599563:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501162880 00000100:00100000:3.0:1783142041.599603:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783142041.599611:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1783142041.599859:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783142041.600198:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501162880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 587us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142041.600206:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783142041.600432:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163264:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 988us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.600439:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1783142041.606875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142041.607454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.607617:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163392 00000100:00100000:2.0:1783142041.607627:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163392 00000100:00100000:0.0:1783142041.607704:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163136 00000100:00100000:0.0:1783142041.607709:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163136 00000100:00080000:1.0:1783142041.607877:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783142041.607926:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783142041.607938:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163392:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783142041.608025:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163392:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 88us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.608041:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783142041.608060:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783142041.608067:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:0:x1869759501163136:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783142041.608081:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783142041.608112:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:0:x1869759501163136:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 47us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.608119:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783142041.609808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.609848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.609881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.609920:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163520 00000100:00100000:0.0:1783142041.609930:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163520 00000100:00100000:0.0:1783142041.609960:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163648 00000100:00100000:0.0:1783142041.609963:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163648 00000100:00100000:0.0:1783142041.609981:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783142041.609988:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501163520:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783142041.610042:0:18650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f535053a-080f-4e4a-b39d-b0db6255876b@192.168.203.39@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1783142041.610071:0:18650:0:(genops.c:1406:class_connect()) connect: client f535053a-080f-4e4a-b39d-b0db6255876b, cookie 0xb31399d6a3808438 00002000:00100000:0.0:1783142041.610081:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f535053a-080f-4e4a-b39d-b0db6255876b/ffff9f9b441a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783142041.610092:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783142041.610166:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783142041.610194:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9f9c4bf58800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142041.610258:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:2399:x1869759501163520:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 269us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.610266:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783142041.610309:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1783142041.610313:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869759501163648:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783142041.610330:0:18650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f535053a-080f-4e4a-b39d-b0db6255876b@192.168.203.39@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1783142041.610346:0:18650:0:(genops.c:1406:class_connect()) connect: client f535053a-080f-4e4a-b39d-b0db6255876b, cookie 0xb31399d6a380843f 00002000:00100000:0.0:1783142041.610351:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f535053a-080f-4e4a-b39d-b0db6255876b/ffff9f9c4bf5a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783142041.610357:0:18650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783142041.610410:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783142041.610433:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9f9c7d818800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783142041.610457:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:2399:x1869759501163648:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 142us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.610464:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783142041.610677:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163776 00000100:00100000:1.0:1783142041.610682:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163776 00000100:00100000:1.0:1783142041.610722:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1783142041.610740:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163776:12345-192.168.203.39@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783142041.610777:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163776:12345-192.168.203.39@tcp:900:mount.lustre.0 Request processed in 48us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142041.610790:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1783142041.622762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142041.622922:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501163904 00000100:00100000:0.0:1783142041.622931:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501163904 00000100:00100000:0.0:1783142041.622985:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783142041.622994:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163904:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783142041.623094:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783142041.623182:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f535053a-080f-4e4a-b39d-b0db6255876b+6:15028:x1869759501163904:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 188us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.623190:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:1.0:1783142041.795504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142041.795633:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164032 00000100:00100000:2.0:1783142041.795644:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164032 00000100:00100000:2.0:1783142041.795705:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1783142041.795716:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+6:15062:x1869759501164032:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:2.0:1783142041.795735:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142041.795755:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795820:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795834:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795846:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142041.795907:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783142041.795911:0:17142:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142041.795929:0:17142:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795953:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 8 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795986:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142041.795994:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:2.0:1783142041.795997:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783142041.796000:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142041.796124:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+7:15062:x1869759501164032:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 408us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142041.796132:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:1.0:1783142041.860921:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521155072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783142041.860994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142041.861247:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155072 00000100:00100000:0.0:1783142041.861255:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155072 00000100:00100000:0.0:1783142041.861323:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783142041.861333:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521155072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783142041.861361:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783142041.861465:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521155072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142041.861473:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783142041.864337:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521155072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783142042.309214:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142042.372699:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521155584:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.372768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.372821:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521156096:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.372845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.372862:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521156608:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.372885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.372905:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783142042.372911:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521155200:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.372937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.372960:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521155712:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.372980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.372993:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521156224:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373039:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521156736:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373085:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521155328:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373111:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373141:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521155840:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373178:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521156352:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373197:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373215:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783142042.373220:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521155456:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373239:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373251:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521155968:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373268:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373308:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521156480:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373343:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.373372:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155584 00000100:00100000:1.0:1783142042.373378:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155584 00000100:00100000:1.0:1783142042.373420:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156096 00000100:00100000:1.0:1783142042.373423:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156096 00000100:00100000:1.0:1783142042.373436:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155456 00000100:00100000:1.0:1783142042.373438:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155456 00000100:00100000:1.0:1783142042.373449:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155968 00000100:00100000:1.0:1783142042.373451:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155968 00000100:00100000:1.0:1783142042.373465:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783142042.373472:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521155584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373520:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1869759521155584:12345-0@lo:400:kworker.0 Request processed in 48us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373528:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783142042.373543:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783142042.373549:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373574:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521156096:12345-0@lo:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373587:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783142042.373599:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783142042.373605:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521155456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373637:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521155456:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373642:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783142042.373653:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783142042.373658:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521155968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373694:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521155968:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373700:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783142042.373721:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155200 00000100:00100000:1.0:1783142042.373725:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155200 00000100:00100000:1.0:1783142042.373750:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783142042.373756:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3652:x1869759521155200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373787:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3652:x1869759521155200:12345-0@lo:400:kworker.0 Request processed in 31us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373793:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783142042.373820:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156608 00000100:00100000:1.0:1783142042.373823:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156608 00000100:00100000:1.0:1783142042.373842:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155712 00000100:00100000:1.0:1783142042.373844:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155712 00000100:00100000:1.0:1783142042.373854:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156224 00000100:00100000:1.0:1783142042.373856:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156224 00000100:00100000:1.0:1783142042.373865:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156736 00000100:00100000:1.0:1783142042.373867:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156736 00000100:00100000:1.0:1783142042.373878:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156352 00000100:00100000:1.0:1783142042.373886:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156352 00000100:00100000:1.0:1783142042.373900:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156480 00000100:00100000:1.0:1783142042.373903:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156480 00000100:00100000:1.0:1783142042.373915:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783142042.373920:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521156608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.373949:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1869759521156608:12345-0@lo:400:kworker.0 Request processed in 29us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.373961:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783142042.373974:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783142042.373980:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521155712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374006:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1869759521155712:12345-0@lo:400:kworker.0 Request processed in 27us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374012:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783142042.374036:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783142042.374042:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374069:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1869759521156224:12345-0@lo:400:kworker.0 Request processed in 27us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374075:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783142042.374085:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783142042.374091:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521156736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374116:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1869759521156736:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374122:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783142042.374132:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783142042.374138:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374162:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1869759521156352:12345-0@lo:400:kworker.0 Request processed in 24us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374174:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783142042.374185:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783142042.374191:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521156480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374218:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1869759521156480:12345-0@lo:400:kworker.0 Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374223:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783142042.374244:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155328 00000100:00100000:1.0:1783142042.374247:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155328 00000100:00100000:1.0:1783142042.374269:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521155840 00000100:00100000:1.0:1783142042.374290:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521155840 00000100:00100000:1.0:1783142042.374305:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783142042.374310:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521155328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374341:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521155328:12345-0@lo:400:kworker.0 Request processed in 30us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374346:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783142042.374357:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783142042.374364:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521155840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374390:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521155840:12345-0@lo:400:kworker.0 Request processed in 26us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.374395:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1783142042.374415:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783142042.374419:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783142042.374422:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783142042.374424:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783142042.374464:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521155456:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374474:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521155968:0@lo:400:kworker.0 00010000:00080000:1.0:1783142042.374494:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bfb80 x1869759521156480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142042.374504:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1869759521156480:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374513:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521155328:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374522:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521155840:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374533:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1869759521156352:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374571:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521155200:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374583:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1869759521155712:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374641:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1869759521156224:0@lo:400:kworker.0 00010000:00080000:1.0:1783142042.374652:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c763bed80 x1869759521156736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783142042.374659:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1869759521156736:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374670:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521155584:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374679:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521156096:0@lo:400:kworker.0 00000100:00100000:1.0:1783142042.374689:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1869759521156608:0@lo:400:kworker.0 00000100:00100000:3.0:1783142042.374843:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783142042.374854:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521156864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783142042.374885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142042.374915:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156864 00000100:00100000:3.0:1783142042.374919:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156864 00000100:00100000:3.0:1783142042.374946:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142042.374953:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521156864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783142042.374969:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783142042.375003:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1869759521156864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142042.375010:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142042.375055:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1869759521156864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783142042.377304:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521156992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783142042.377363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142042.377425:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521156992 00000100:00100000:2.0:1783142042.377432:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521156992 00000100:00100000:2.0:1783142042.377470:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142042.377477:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521156992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783142042.377512:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783142042.377550:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1869759521156992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142042.377556:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142042.377591:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521156992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783142042.884816:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783142042.884884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.884940:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157120 00000100:00100000:1.0:1783142042.884947:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157120 00000100:00100000:1.0:1783142042.884993:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783142042.885011:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783142042.885046:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783142042.885092:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.885099:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783142042.885148:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783142042.888667:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783142042.888689:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783142042.888751:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142042.888789:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157248 00000100:00100000:1.0:1783142042.888795:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157248 00000100:00100000:1.0:1783142042.888839:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783142042.888848:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783142042.888881:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783142042.888924:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142042.888931:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783142042.888973:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157248:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1783142042.890460:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f535053a-080f-4e4a-b39d-b0db6255876b 00000001:00100000:1.0:1783142042.890481:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0551ecf9-9ef0-4599-b72d-437ccd3f3832 00000001:00080000:1.0:1783142042.890490:0:19462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1783142043.332521:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783142044.085250:0:20018:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783142044.357193:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783142044.934244:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f535053a-080f-4e4a-b39d-b0db6255876b 00000001:00100000:2.0:1783142044.934258:0:17875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0551ecf9-9ef0-4599-b72d-437ccd3f3832 00000001:00100000:0.0:1783142044.935867:0:17122:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f535053a-080f-4e4a-b39d-b0db6255876b 00000001:00100000:0.0:1783142044.935879:0:17122:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0551ecf9-9ef0-4599-b72d-437ccd3f3832 00000001:00100000:2.0:1783142044.939694:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f535053a-080f-4e4a-b39d-b0db6255876b 00000001:00100000:2.0:1783142044.939708:0:18644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0551ecf9-9ef0-4599-b72d-437ccd3f3832 00010000:00010000:1.0:1783142045.380897:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142045.962850:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521157376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783142045.962922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142045.963007:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157376 00000100:00100000:3.0:1783142045.963023:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157376 00000100:00100000:3.0:1783142045.963074:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783142045.963083:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521157376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783142045.963115:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783142045.963168:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521157376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142045.963175:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1783142045.963195:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783142045.963295:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521157376:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783142046.412118:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142046.980053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142046.980257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142046.980489:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164160 00000100:00100000:2.0:1783142046.980499:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164160 00000100:00100000:2.0:1783142046.980551:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:2.0:1783142046.980561:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:2402:x1869759501164160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.980628:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:2402:x1869759501164160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.980636:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:2.0:1783142046.980698:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164416 00000100:00100000:2.0:1783142046.980702:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164416 00000100:00100000:2.0:1783142046.980732:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164928 00000100:00100000:2.0:1783142046.980735:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164928 00000100:00100000:2.0:1783142046.980748:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164288 00000100:00100000:2.0:1783142046.980750:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164288 00000100:00100000:2.0:1783142046.980760:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164800 00000100:00100000:2.0:1783142046.980763:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164800 00000100:00100000:2.0:1783142046.980776:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:2.0:1783142046.980782:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.980814:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.980820:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:2.0:1783142046.980832:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1783142046.980838:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501164928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.980862:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501164928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.980880:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1783142046.980892:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783142046.980899:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501164288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.980926:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501164288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.980932:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783142046.980944:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783142046.980949:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:2402:x1869759501164800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.980970:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:2402:x1869759501164800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.980976:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783142046.981003:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164672 00000100:00100000:2.0:1783142046.981007:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164672 00000100:00100000:2.0:1783142046.981024:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165184 00000100:00100000:2.0:1783142046.981026:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165184 00000100:00100000:2.0:1783142046.981036:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501164544 00000100:00100000:2.0:1783142046.981038:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501164544 00000100:00100000:2.0:1783142046.981048:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165056 00000100:00100000:2.0:1783142046.981050:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165056 00000100:00100000:2.0:1783142046.981062:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783142046.981067:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.981106:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.981113:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783142046.981125:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783142046.981138:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501165184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.981163:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c763bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501165184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.981168:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783142046.981179:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783142046.981185:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.981205:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501164544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.981211:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783142046.981220:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783142046.981225:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501165056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142046.981259:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501165056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.981266:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783142046.981916:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783142046.981934:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521157504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783142046.981977:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142046.982163:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157504 00000100:00100000:2.0:1783142046.982169:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157504 00000100:00100000:2.0:1783142046.982207:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783142046.982214:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521157504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783142046.982241:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1783142046.982469:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783142046.982475:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783142046.982477:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783142046.982479:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783142046.982718:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521157504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 503us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142046.982726:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783142046.983320:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521157504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783142047.431471:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142047.492763:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783142047.492838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.492893:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783142047.492900:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521157760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783142047.492924:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.492955:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157632 00000100:00100000:3.0:1783142047.492962:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157632 00000100:00100000:3.0:1783142047.493016:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157760 00000100:00100000:3.0:1783142047.493020:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157760 00000100:00100000:3.0:1783142047.493042:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783142047.493051:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783142047.493080:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783142047.493125:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521157632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.493133:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783142047.493149:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783142047.493171:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521157760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783142047.493182:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783142047.493208:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1869759521157760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.493213:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783142047.493234:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783142047.493267:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1869759521157760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783142047.493294:0:3652:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1783142047.493311:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521157632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783142047.495634:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521157888:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142047.495734:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521158400:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142047.495776:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521158912:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495803:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142047.495824:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783142047.495830:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521158016:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495852:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142047.495868:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521158528:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495900:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142047.495917:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521159040:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.495940:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142047.496847:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521157888 00000100:00100000:1.0:1783142047.496857:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521157888 00000100:00100000:1.0:1783142047.496918:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783142047.496927:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3654:x1869759521157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497000:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3654:x1869759521157888:12345-0@lo:400:kworker.0 Request processed in 74us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497008:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783142047.497060:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158016 00000100:00100000:1.0:1783142047.497063:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158016 00000100:00100000:1.0:1783142047.497086:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783142047.497092:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497130:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521158016:12345-0@lo:400:kworker.0 Request processed in 38us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497136:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783142047.497152:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158912 00000100:00100000:1.0:1783142047.497163:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158912 00000100:00100000:1.0:1783142047.497193:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158528 00000100:00100000:1.0:1783142047.497196:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158528 00000100:00100000:1.0:1783142047.497209:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159040 00000100:00100000:1.0:1783142047.497211:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159040 00000100:00100000:1.0:1783142047.497223:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783142047.497230:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521158912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497677:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521158912:12345-0@lo:400:kworker.0 Request processed in 447us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497684:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783142047.497697:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783142047.497703:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497735:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1869759521158528:12345-0@lo:400:kworker.0 Request processed in 32us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497740:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783142047.497750:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783142047.497757:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521159040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497789:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1869759521159040:12345-0@lo:400:kworker.0 Request processed in 33us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497794:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783142047.497814:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158400 00000100:00100000:1.0:1783142047.497818:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158400 00000100:00100000:1.0:1783142047.497850:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783142047.497857:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142047.497888:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521158400:12345-0@lo:400:kworker.0 Request processed in 32us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142047.497893:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783142047.498001:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783142047.498006:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783142047.498008:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783142047.498409:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521158016:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.498423:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1869759521158528:0@lo:400:kworker.0 00010000:00080000:0.0:1783142047.498436:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ac000 x1869759521159040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142047.498447:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1869759521159040:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.498456:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521157888:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.498465:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521158400:0@lo:400:kworker.0 00000100:00100000:0.0:1783142047.498475:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521158912:0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.499222:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521158272:0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.499292:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.499323:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521158784:0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.499365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.499390:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783142047.499397:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521158144:0@lo:400:kworker.0 00000100:00100000:2.0:1783142047.499411:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158272 00000100:00100000:3.0:1783142047.499425:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142047.499426:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158272 00000100:00100000:3.0:1783142047.499448:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521158656:0@lo:400:kworker.0 00000100:00100000:2.0:1783142047.499472:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158784 00000100:00100000:3.0:1783142047.499473:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142047.499478:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158784 00000100:00100000:3.0:1783142047.499510:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158144 00000100:00100000:3.0:1783142047.499516:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158144 00000100:00100000:2.0:1783142047.499516:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521158656 00000100:00100000:2.0:1783142047.499522:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521158656 00000100:00100000:2.0:1783142047.499550:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783142047.499559:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521158272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.499562:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783142047.499574:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521158144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142047.499626:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521158272:12345-0@lo:400:kworker.0 Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.499629:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521158144:12345-0@lo:400:kworker.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142047.499638:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783142047.499643:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783142047.499661:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783142047.499670:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521158784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.499677:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783142047.499687:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521158656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142047.499706:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521158784:12345-0@lo:400:kworker.0 Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142047.499712:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783142047.499731:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1869759521158656:12345-0@lo:400:kworker.0 Request processed in 46us (257us total) trans 0 rc 0/0 00000100:00080000:2.0:1783142047.499737:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783142047.499741:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783142047.499744:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783142047.499748:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783142047.508699:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521158144:0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.508720:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1869759521158656:0@lo:400:kworker.0 00000100:00100000:3.0:1783142047.508735:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521158272:0@lo:400:kworker.0 00010000:00080000:3.0:1783142047.508752:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c762ae300 x1869759521158784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783142047.508762:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521158784:0@lo:400:kworker.0 00000020:00000080:2.0:1783142047.565891:0:20165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd24edf0e0 20000000:00000080:2.0:1783142047.565908:0:20165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f9c43529400 uarg=0000000000000000 20000000:01000000:2.0:1783142047.565958:0:20165:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783142047.565964:0:20165:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783142047.565968:0:20165:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783142047.566626:0:20166:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1783142047.566761:0:20165:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783142047.574747:0:20165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783142047.574778:0:20165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574797:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574820:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574826:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380812f expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574833:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a380828d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574841:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574848:0:20165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574857:0:20165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574955:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.574969:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 12 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.574994:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159168:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142047.575102:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.575110:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 12 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.575124:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159296:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142047.575157:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.575164:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 23 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.575172:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159424:0@lo:104: 00000100:00100000:2.0:1783142047.575206:0:20165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783142047.575244:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.575251:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 23 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.575259:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159552:0@lo:104: 00000100:00100000:2.0:1783142047.575307:0:20165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783142047.575333:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142047.575709:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.575723:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159680:0@lo:104: 00000100:00100000:3.0:1783142047.575735:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159424 00000100:00100000:3.0:1783142047.575743:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159424 00000100:00100000:2.0:1783142047.575751:0:20165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783142047.575773:0:20165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 23 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.575778:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159552 00000100:00100000:3.0:1783142047.575781:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159552 00000100:00100000:3.0:1783142047.575790:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159680 00000100:00100000:3.0:1783142047.575793:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159680 00010000:00010000:2.0:1783142047.575795:0:20165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 23 pid: 17135 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.575806:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783142047.575808:0:20165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159808:0@lo:104: 00000100:00100000:3.0:1783142047.575817:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:20165:x1869759521159424:12345-0@lo:104: 00010000:00010000:3.0:1783142047.575830:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142047.575835:0:20165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142047.575849:0:20165:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c7c59ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1783142047.575901:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783142047.575907:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:20165:x1869759521159424:12345-0@lo:104: Request processed in 92us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.575914:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783142047.575936:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159808 00000100:00100000:3.0:1783142047.575939:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159808 00000100:00100000:3.0:1783142047.575950:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783142047.575963:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:20165:x1869759521159552:12345-0@lo:104: 00010000:00010000:3.0:1783142047.575971:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576014:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783142047.576019:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+5:20165:x1869759521159552:12345-0@lo:104: Request processed in 64us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.576025:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783142047.576036:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142047.576041:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:20165:x1869759521159680:12345-0@lo:104: 00010000:00010000:3.0:1783142047.576047:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576078:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783142047.576085:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+4:20165:x1869759521159680:12345-0@lo:104: Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.576090:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142047.576102:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783142047.576107:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:20165:x1869759521159808:12345-0@lo:104: 00010000:00010000:3.0:1783142047.576114:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576155:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783142047.576163:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+3:20165:x1869759521159808:12345-0@lo:104: Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.576177:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783142047.576225:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159424:0@lo:104: 00000100:00100000:2.0:1783142047.576234:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159552:0@lo:104: 00000100:00100000:2.0:1783142047.576241:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159680:0@lo:104: 00000100:00100000:2.0:1783142047.576246:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159808:0@lo:104: 00010000:00010000:3.0:1783142047.576604:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783142047.576611:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576619:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168e400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142047.576624:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576632:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142047.576639:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142047.576643:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142047.576677:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576683:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142047.576699:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576705:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168e400/0xb31399d6a380828d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808294 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576718:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783142047.576721:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576738:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c74cc2400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142047.576742:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576748:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142047.576753:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142047.576758:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142047.576772:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576778:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142047.576784:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576790:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c74cc2400/0xb31399d6a380812f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a3808136 expref: -99 pid: 18643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576801:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783142047.576804:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576809:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168f400 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142047.576811:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576828:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142047.576834:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142047.576839:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142047.576852:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576857:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142047.576873:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576879:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168f400/0xb31399d6a38080f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080f7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576889:0:17130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783142047.576891:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576897:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c4168fe00 already unused, calling callback (ffffffffc1373c20) 10000000:00010000:3.0:1783142047.576899:0:17130:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576906:0:17130:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783142047.576911:0:17130:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142047.576923:0:17130:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783142047.576938:0:17130:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576943:0:17130:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783142047.576949:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576955:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9f9c4168fe00/0xb31399d6a38080e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb31399d6a38080e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.576967:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142047.576969:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142047.576971:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783142047.576978:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142047.577013:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521159936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.577076:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783142047.577082:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521160064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.577126:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521160192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.577161:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783142047.577166:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521160320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577182:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142047.577205:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521159936 00000100:00100000:3.0:1783142047.577210:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521159936 00010000:00010000:3.0:1783142047.577240:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 24 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.577257:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160064 00000100:00100000:3.0:1783142047.577260:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160064 00010000:00010000:3.0:1783142047.577269:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 25 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.577300:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160192 00000100:00100000:3.0:1783142047.577302:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160192 00010000:00010000:3.0:1783142047.577313:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 26 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.577321:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160320 00000100:00100000:3.0:1783142047.577323:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160320 00010000:00010000:3.0:1783142047.577331:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 27 pid: 17135 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.577343:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783142047.577350:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+27:3652:x1869759521159936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142047.577361:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142047.577366:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 27 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577374:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 27 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577387:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a3808294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380828d expref: 27 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577399:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142047.577429:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+26:3652:x1869759521159936:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.577442:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783142047.577456:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783142047.577462:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+25:3652:x1869759521160064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142047.577469:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142047.577474:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 25 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577482:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 25 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577492:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1c00/0xb31399d6a3808136 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a380812f expref: 25 pid: 17137 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577500:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142047.577521:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3652:x1869759521160064:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.577527:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783142047.577538:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142047.577543:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:3654:x1869759521160192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142047.577550:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142047.577553:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577561:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577572:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b4407e600/0xb31399d6a38080f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38080f0 expref: 23 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577590:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142047.577615:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:3654:x1869759521160192:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.577621:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783142047.577631:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783142047.577636:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:3654:x1869759521160320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783142047.577644:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142047.577647:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 21 pid: 17135 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577655:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 21 pid: 17135 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577665:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b0200/0xb31399d6a38080e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb31399d6a38080e2 expref: 21 pid: 17135 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.577672:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142047.577691:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:3654:x1869759521160320:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.577696:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783142047.577729:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521160320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577737:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521160192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577761:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521160064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783142047.577768:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3652:1869759521159936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783142047.578636:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142047.582340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142047.582432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142047.583122:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159168:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783142047.583136:0:20165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20165:1869759521159296:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783142047.583176:0:20165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.583245:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165312 00000100:00100000:3.0:1783142047.583264:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165312 00010000:00010000:3.0:1783142047.583312:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 13 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.583337:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165440 00000100:00100000:3.0:1783142047.583340:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165440 00010000:00010000:3.0:1783142047.583350:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 14 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.583363:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783142047.583371:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c77755050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+14:2403:x1869759501165312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142047.583387:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142047.583391:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 14 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.583401:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 14 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142047.583600:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783142047.583611:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1783142047.584021:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1000/0xb31399d6a3808423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea95 expref: 14 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142047.584038:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783142047.584110:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:0.0:1783142047.584122:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:2403:x1869759501165440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783142047.584133:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783142047.584139:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 13 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584163:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 13 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584174:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9b41bd5000/0xb31399d6a38083e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea25 expref: 13 pid: 17136 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584186:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584192:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584204:0:17129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584210:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584215:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584221:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584226:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142047.584230:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584238:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142047.584586:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c77755050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:2403:x1869759501165312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1212us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142047.584597:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00010000:00010000:0.0:1783142047.584726:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584742:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783142047.584771:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:2403:x1869759501165440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 651us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142047.584779:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:0.0:1783142047.584826:0:20165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584833:0:20165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142047.584839:0:20165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f9c6f7b1400/0xb31399d6a3808454 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783142047.748960:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783142048.005066:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521160448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783142048.005138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142048.005196:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160448 00000100:00100000:0.0:1783142048.005203:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160448 00000100:00100000:0.0:1783142048.005257:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783142048.005266:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521160448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783142048.005318:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783142048.005361:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521160448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142048.005369:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783142048.005418:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521160448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783142048.006367:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783142048.006379:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521160576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783142048.006422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142048.006638:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160576 00000100:00100000:2.0:1783142048.006645:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160576 00000100:00100000:2.0:1783142048.006760:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783142048.006771:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521160576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783142048.006794:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783142048.006843:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7630ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521160576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142048.006850:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783142048.006963:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521160576:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783142048.008065:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783142048.454859:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142049.154060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142049.154156:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165568 00000100:00100000:2.0:1783142049.154166:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165568 00000100:00100000:2.0:1783142049.154224:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:2.0:1783142049.154234:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+11:14913:x1869759501165568:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783142049.154249:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142049.154268:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a380845b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eacd expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142049.154371:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a380845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eacd expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142049.154382:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9c6f7b0400/0xb31399d6a380845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eacd expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142049.154390:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0400, rc 0) 00000100:00100000:2.0:1783142049.154733:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165568:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 499us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142049.154741:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:2.0:1783142049.159190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142049.159284:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165696 00000100:00100000:1.0:1783142049.159508:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165696 00000100:00100000:1.0:1783142049.159588:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:1.0:1783142049.159597:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165696:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783142049.159731:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165696:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 135us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.159739:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:0.0:1783142049.163136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142049.170307:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165824 00000100:00100000:2.0:1783142049.170322:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165824 00000100:00100000:2.0:1783142049.170386:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:2.0:1783142049.170396:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165824:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783142049.170544:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165824:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 148us (7417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142049.170553:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:1.0:1783142049.176605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142049.176643:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501165952 00000100:00100000:1.0:1783142049.176651:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501165952 00000100:00100000:1.0:1783142049.176693:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:1.0:1783142049.176701:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+12:14913:x1869759501165952:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142049.176718:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142049.176741:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd5e00/0xb31399d6a3808462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd3d22d190116ead4 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.176769:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd5e00/0xb31399d6a3808462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ead4 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.176781:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd5e00/0xb31399d6a3808462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ead4 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.176790:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd5e00, rc 0) 00000100:00100000:1.0:1783142049.176836:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:14913:x1869759501165952:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 136us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.176961:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:2.0:1783142049.184753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142049.184854:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166080 00000100:00100000:1.0:1783142049.184863:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166080 00000100:00100000:1.0:1783142049.184949:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:1.0:1783142049.184960:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:14913:x1869759501166080:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783142049.185149:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7c96f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:14913:x1869759501166080:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 191us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.185157:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:0.0:1783142049.187460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142049.187756:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166208 00000100:00100000:1.0:1783142049.187767:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166208 00000100:00100000:1.0:1783142049.187874:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:1.0:1783142049.187892:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:14913:x1869759501166208:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783142049.188046:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:14913:x1869759501166208:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 162us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.188054:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 151 10000000:01000000:3.0:1783142049.220389:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783142049.220396:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6ccea800 from 13 10000000:01000000:3.0:1783142049.220400:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783142049.220448:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.220479:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.220491:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142049.220517:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.220584:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.220632:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783142049.220986:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160704 00000100:00100000:1.0:1783142049.220994:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160704 00000100:00100000:1.0:1783142049.221049:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783142049.221059:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+20:17140:x1869759521160704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142049.221072:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142049.221085:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd4000/0xb31399d6a3808470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808469 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.221108:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd4000/0xb31399d6a3808470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808469 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.221118:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd4000/0xb31399d6a3808470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808469 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.221127:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4000, rc 0) 00000100:00100000:1.0:1783142049.221177:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521160704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.221184:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783142049.221471:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142049.221488:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808470 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.221497:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a3808470 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142049.221562:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.221591:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.221613:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783142049.221670:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160832 00000100:00100000:1.0:1783142049.221675:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160832 00000100:00100000:1.0:1783142049.221713:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783142049.221720:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521160832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783142049.221847:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521160832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.221854:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783142049.221961:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.222000:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.222044:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.222067:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142049.222319:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521160960 00000100:00100000:2.0:1783142049.222336:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521160960 00000100:00100000:2.0:1783142049.222369:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783142049.222376:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521160960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783142049.222484:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521160960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142049.222501:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783142049.222592:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521160960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783142049.225468:0:20236:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783142049.225683:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783142049.225705:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783142049.225717:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808470 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.225729:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b423e0800/0xb31399d6a3808469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a3808470 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783142049.225741:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783142049.225743:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c79bae000 from 13 10000000:01000000:0.0:1783142049.225746:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783142049.225783:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.225791:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.225802:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142049.225825:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.225901:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142049.225944:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b43411840 going to sleep for 11 seconds 00000100:00100000:1.0:1783142049.226434:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161088 00000100:00100000:1.0:1783142049.226442:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161088 00000100:00100000:1.0:1783142049.226490:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783142049.226499:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+21:17140:x1869759521161088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783142049.226523:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142049.226537:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b41bd4600/0xb31399d6a380847e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808477 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.226561:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b41bd4600/0xb31399d6a380847e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808477 expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.226572:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b41bd4600/0xb31399d6a380847e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808477 expref: 22 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142049.226580:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4600, rc 0) 00000100:00100000:1.0:1783142049.226629:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.226635:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783142049.227383:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783142049.227402:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380847e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.227425:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380847e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142049.227496:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.227533:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142049.227565:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b43411840 going to sleep for 11 seconds 00000100:00100000:2.0:1783142049.228239:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161216 00000100:00100000:2.0:1783142049.228247:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161216 00000100:00100000:2.0:1783142049.228304:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783142049.228313:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783142049.229017:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 701us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142049.229026:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783142049.229217:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.229266:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.229417:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142049.229451:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9b43411840 going to sleep for 11 seconds 00000100:00100000:1.0:1783142049.229527:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161344 00000100:00100000:1.0:1783142049.229532:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161344 00000100:00100000:1.0:1783142049.229568:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783142049.229575:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783142049.229656:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142049.229662:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783142049.230413:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783142049.236888:0:20237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783142049.236950:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783142049.236988:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783142049.236999:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380847e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.237012:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407f400/0xb31399d6a3808477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380847e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783142049.237023:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783142049.237025:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9b432c5800 from 13 10000000:01000000:3.0:1783142049.237029:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783142049.237064:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.237073:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.237083:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142049.237107:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.237166:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.237205:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783142049.238831:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161472 00000100:00100000:3.0:1783142049.238891:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161472 00000100:00100000:3.0:1783142049.239009:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783142049.239020:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+22:17140:x1869759521161472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142049.239042:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142049.239058:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b423e0400/0xb31399d6a380848c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808485 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.239089:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b423e0400/0xb31399d6a380848c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808485 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.239100:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b423e0400/0xb31399d6a380848c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808485 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.239109:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e0400, rc 0) 00000100:00100000:3.0:1783142049.239178:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142049.239185:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783142049.239237:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142049.239253:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380848c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.239262:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380848c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142049.239738:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.239775:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.239810:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783142049.239834:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161600 00000100:00100000:3.0:1783142049.239911:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161600 00000100:00100000:3.0:1783142049.240047:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783142049.240056:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.240164:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142049.240185:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783142049.240224:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.240251:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.240308:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.240505:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4915a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783142049.240518:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161728 00000100:00100000:3.0:1783142049.240521:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161728 00000100:00100000:3.0:1783142049.240540:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783142049.240546:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.240622:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142049.240629:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783142049.240668:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783142049.242187:0:20238:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783142049.242582:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783142049.242604:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783142049.242615:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380848c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.242628:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b423e1600/0xb31399d6a3808485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380848c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783142049.242640:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783142049.242643:0:17140:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f9c6f7af000 from 13 10000000:01000000:0.0:1783142049.242646:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783142049.242683:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.242691:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.242717:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142049.242740:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.242798:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142049.242953:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c79b3dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783142049.243107:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161856 00000100:00100000:3.0:1783142049.243115:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161856 00000100:00100000:3.0:1783142049.243197:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783142049.243208:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+23:17140:x1869759521161856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142049.243221:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142049.243233:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f9b423e1a00/0xb31399d6a380849a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb31399d6a3808493 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.243256:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f9b423e1a00/0xb31399d6a380849a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb31399d6a3808493 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.243304:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f9b423e1a00/0xb31399d6a380849a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb31399d6a3808493 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.243313:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e1a00, rc 0) 00000100:00100000:3.0:1783142049.243372:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521161856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142049.243379:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783142049.243681:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6ccc9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783142049.243697:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380849a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142049.243705:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb31399d6a380849a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142049.243763:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.243792:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.243868:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c42be1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783142049.244063:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521161984 00000100:00100000:0.0:1783142049.244068:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521161984 00000100:00100000:0.0:1783142049.244134:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783142049.244142:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521161984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783142049.244260:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521161984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142049.244268:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783142049.244548:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521161984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.244579:0:17140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521162112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783142049.244619:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142049.244651:0:17140:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c42be1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142049.245568:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521162112 00000100:00100000:2.0:1783142049.245577:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521162112 00000100:00100000:2.0:1783142049.245618:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783142049.245624:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521162112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783142049.245732:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:17140:x1869759521162112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142049.245739:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783142049.245821:0:17140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b0f07033-43f3-43e4-aeca-29a1a105dcc2:17140:1869759521162112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783142049.247934:0:20240:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783142049.248209:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783142049.248231:0:17140:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783142049.248242:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380849a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142049.248254:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9f9b4407e600/0xb31399d6a3808493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb31399d6a380849a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142049.477578:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142050.508960:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783142051.077311:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521162240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783142051.077404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142051.077658:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521162240 00000100:00100000:2.0:1783142051.077666:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521162240 00000100:00100000:2.0:1783142051.077734:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783142051.077745:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521162240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783142051.077790:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783142051.077836:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521162240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142051.077843:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783142051.077997:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521162240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783142051.078076:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783142051.255627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.259186:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166336 00000100:00100000:1.0:1783142051.259290:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166336 00000100:00100000:1.0:1783142051.259578:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783142051.259601:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:15578:x1869759501166336:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783142051.259620:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142051.259654:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eadb expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259710:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259723:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259744:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259758:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259765:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259771:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259840:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4800/0xb31399d6a38084b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259847:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4800/0xb31399d6a38084b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259853:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4800/0xb31399d6a38084b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783142051.259877:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783142051.259880:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783142051.259922:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4800/0xb31399d6a38084b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259948:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259955:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259973:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259979:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783142051.259984:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.259992:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260004:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:1.0:1783142051.260006:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.260010:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260016:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260028:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260034:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260040:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260050:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd4200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783142051.260054:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260060:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260067:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f9c7b5c2a00) 00010000:00010000:1.0:1783142051.260069:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.260071:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260077:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260104:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eadb expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260117:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4800/0xb31399d6a38084b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eadb expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.260123:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c7b5c2000) 00010000:00010000:1.0:1783142051.260126:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783142051.260128:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4800, rc 0) 00000100:00100000:1.0:1783142051.260265:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:15578:x1869759501166336:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 667us (4644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142051.260307:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00080000:3.0:1783142051.260725:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783142051.275001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.275238:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166464 00000100:00100000:3.0:1783142051.275247:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166464 00000100:00100000:3.0:1783142051.275604:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783142051.275615:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:15578:x1869759501166464:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783142051.275701:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:15578:x1869759501166464:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 Request processed in 87us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.275710:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1783142051.283618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.283771:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166720 00000100:00100000:2.0:1783142051.283786:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166720 00000100:00100000:2.0:1783142051.283933:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1783142051.283945:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:15578:x1869759501166720:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783142051.283973:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.283994:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38084bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eae2 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284064:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284089:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284100:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284171:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284180:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284187:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284342:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38084d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284351:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38084d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284358:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38084d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.284367:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783142051.284640:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284648:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284655:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284661:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.284665:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284672:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284684:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f9c7b5c2000) 00010000:00010000:2.0:1783142051.284687:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.284691:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284707:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38084c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284775:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284782:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284787:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284792:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.284795:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284800:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284808:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.284810:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.284813:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.284818:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a38084cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.286180:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38084bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eae2 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.286219:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0200/0xb31399d6a38084d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eae2 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.286228:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9b42686200) 00010000:00010000:2.0:1783142051.286231:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.286234:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0200, rc 0) 00000100:00100000:2.0:1783142051.286323:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15578:x1869759501166720:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2369us (2703us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783142051.286332:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1783142051.299855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142051.300543:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166848 00000100:00100000:0.0:1783142051.300555:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166848 00000100:00100000:0.0:1783142051.300609:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783142051.300619:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15578:x1869759501166848:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783142051.305983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.306201:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501166976 00000100:00100000:1.0:1783142051.306224:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501166976 00000100:00100000:1.0:1783142051.306337:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1783142051.306347:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:15578:x1869759501166976:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1783142051.306498:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783142051.306778:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15578:x1869759501166848:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 103us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142051.306799:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000004:00080000:2.0:1783142051.310422:0:17144:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4033us 00000100:00100000:2.0:1783142051.321181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.321328:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167104 00000100:00100000:1.0:1783142051.321338:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167104 00000100:00100000:1.0:1783142051.321399:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:1.0:1783142051.321502:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15584:x1869759501167104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783142051.321633:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142051.321670:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eae9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.321737:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322497:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322511:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322651:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322660:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322667:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322708:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322722:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322729:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.322735:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd4200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783142051.322739:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323081:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323095:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:1.0:1783142051.323098:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.323102:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323108:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38084e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323124:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323130:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323135:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323140:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783142051.323150:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323157:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323165:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:1.0:1783142051.323168:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.323171:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323177:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a38084ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323220:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eae9 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323231:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:1.0:1783142051.323233:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.323237:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eae9 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.323247:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd5c00, rc 0) 00000100:00100000:1.0:1783142051.323353:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15584:x1869759501167104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1944us (2181us total) trans 0 rc 301/301 00000100:00100000:1.0:1783142051.323363:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:3.0:1783142051.329322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142051.329621:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167232 00000100:00100000:0.0:1783142051.329631:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167232 00000100:00100000:0.0:1783142051.329682:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783142051.329692:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15584:x1869759501167232:12345-192.168.203.39@tcp:700:lfs.0 00000100:00100000:0.0:1783142051.329790:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15584:x1869759501167232:12345-192.168.203.39@tcp:700:lfs.0 Request processed in 99us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142051.329797:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783142051.332199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.332303:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167488 00000100:00100000:1.0:1783142051.332320:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167488 00000100:00100000:1.0:1783142051.332368:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783142051.332378:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:15584:x1869759501167488:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1783142051.332460:0:18453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783142051.332486:0:18453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380840e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116ea56 expref: 9 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.332504:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:1.0:1783142051.332514:0:18453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783142051.332570:0:18453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.332584:0:18453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 5 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.332593:0:18453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.332625:0:18453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 5 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.332638:0:18453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 5 pid: 17142 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142051.332652:0:18453:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18453:1869759521162368:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783142051.332726:0:18453:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142051.336109:0:18453:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18453:1869759521162368:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142051.336137:0:18453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142051.337243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.337593:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167616 00000100:00100000:3.0:1783142051.337602:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167616 00010000:00010000:3.0:1783142051.337661:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 6 pid: 17142 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142051.337705:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:3.0:1783142051.337715:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f535053a-080f-4e4a-b39d-b0db6255876b+6:2402:x1869759501167616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142051.337731:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142051.337738:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 6 pid: 17142 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783142051.338175:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783142051.338367:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 6 pid: 17142 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.338395:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380844d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eac6 expref: 6 pid: 17142 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.338429:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:3.0:1783142051.338434:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.338443:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.338450:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.338484:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142051.338535:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501167616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 821us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.338544:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00010000:00010000:1.0:1783142051.339857:0:18453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.339870:0:18453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.339911:0:18453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.339923:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.339933:0:18453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342339:0:18453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342361:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342372:0:18453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783142051.342389:0:18453:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018f28dbf reply state 000000007c131c77 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342401:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342408:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:1.0:1783142051.342411:0:18453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783142051.342414:0:18453:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783142051.342420:0:18453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783142051.342427:0:18453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342434:0:18453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342448:0:18453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342455:0:18453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5600 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:1.0:1783142051.342459:0:18453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342467:0:18453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342477:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686900) 00010000:00010000:1.0:1783142051.342479:0:18453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783142051.342483:0:18453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342489:0:18453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5600/0xb31399d6a38084f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783142051.342504:0:18453:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018f28dbf reply state 000000007c131c77 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342513:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.342525:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:1.0:1783142051.342527:0:18453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783142051.342529:0:18453:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783142051.342628:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+10:15584:x1869759501167488:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 10248us (10446us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783142051.342638:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783142051.345300:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:15578:x1869759501166976:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 38945us (39316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142051.345313:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:0.0:1783142051.434855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.435563:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167744 00000100:00100000:2.0:1783142051.435574:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167744 00000100:00100000:2.0:1783142051.435642:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1783142051.435652:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+10:15592:x1869759501167744:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:2.0:1783142051.435674:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.435696:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a380850a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eaf0 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435789:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808511 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435803:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435814:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.435857:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783142051.435862:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142051.435908:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435932:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a380850a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eaf0 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435950:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1400/0xb31399d6a3808511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eaf0 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.435970:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.435973:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783142051.435977:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1400, rc 0) 00000100:00100000:2.0:1783142051.436143:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+11:15592:x1869759501167744:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 491us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142051.436151:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783142051.460459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.460583:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501167872 00000100:00100000:3.0:1783142051.460593:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501167872 00000100:00100000:3.0:1783142051.460697:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1783142051.460708:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f535053a-080f-4e4a-b39d-b0db6255876b+5:15593:x1869759501167872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783142051.460729:0:19933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142051.460749:0:19933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eaf7 expref: -99 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.460811:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1400/0xb31399d6a380851f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.460824:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1400/0xb31399d6a380851f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.460852:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1400/0xb31399d6a380851f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783142051.460918:0:19933:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783142051.460922:0:19933:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783142051.460944:0:19933:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1400/0xb31399d6a380851f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.460982:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eaf7 expref: 7 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.461000:0:19933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1400/0xb31399d6a380851f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eaf7 expref: 6 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.461009:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:3.0:1783142051.461012:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783142051.461015:0:19933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e1400, rc 0) 00000100:00100000:3.0:1783142051.461074:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f535053a-080f-4e4a-b39d-b0db6255876b+6:15593:x1869759501167872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 368us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.461082:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:1.0:1783142051.464494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.464774:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501168000 00000100:00100000:2.0:1783142051.464784:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501168000 00000100:00100000:2.0:1783142051.464864:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:2.0:1783142051.464875:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+6:15593:x1869759501168000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783142051.465113:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.469344:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eafe expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469429:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469443:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469457:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469469:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469477:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469483:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469558:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469567:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469574:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.469630:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783142051.469635:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142051.469657:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469669:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469676:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469682:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469688:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.469691:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469699:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469710:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.469712:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.469716:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469721:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a380852d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469733:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469749:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469755:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469760:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.469763:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469770:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469778:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:2.0:1783142051.469781:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.469783:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469790:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a3808534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469815:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eafe expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469827:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eafe expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.469840:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:2.0:1783142051.469841:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783142051.469850:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142051.469929:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c76309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+7:15593:x1869759501168000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5055us (5442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142051.469938:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783142051.473016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.473847:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501168128 00000100:00100000:3.0:1783142051.473858:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501168128 00000100:00100000:3.0:1783142051.474001:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783142051.474011:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f535053a-080f-4e4a-b39d-b0db6255876b+5:15593:x1869759501168128:12345-192.168.203.39@tcp:900:lfs.0 00000100:00100000:3.0:1783142051.474104:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f535053a-080f-4e4a-b39d-b0db6255876b+5:15593:x1869759501168128:12345-192.168.203.39@tcp:900:lfs.0 Request processed in 94us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.474112:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00080000:1.0:1783142051.474854:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783142051.483772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.483946:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501168384 00000100:00100000:1.0:1783142051.483967:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501168384 00000100:00100000:1.0:1783142051.484032:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:1.0:1783142051.484042:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+7:15593:x1869759501168384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783142051.484063:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142051.484084:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a3808542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb05 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783142051.484193:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783142051.484344:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a3808542 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb05 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.484359:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:1.0:1783142051.484362:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783142051.484368:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a3808542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb05 expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142051.484381:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4200, rc 0) 00000100:00100000:1.0:1783142051.484443:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f535053a-080f-4e4a-b39d-b0db6255876b+8:15593:x1869759501168384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 403us (681us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783142051.484450:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1783142051.490721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.491072:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501168640 00000100:00100000:3.0:1783142051.491082:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501168640 00000100:00100000:3.0:1783142051.491135:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783142051.491144:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f535053a-080f-4e4a-b39d-b0db6255876b+8:15593:x1869759501168640:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1783142051.492563:0:19933:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142051.492599:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380853b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eafe expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.492622:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:3.0:1783142051.492628:0:19933:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783142051.492654:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.492668:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.492678:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783142051.492874:0:19933:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d144137 reply state 00000000f835e636 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.492888:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.492895:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:3.0:1783142051.492898:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1783142051.492900:0:19933:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783142051.492907:0:19933:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783142051.493001:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f535053a-080f-4e4a-b39d-b0db6255876b+9:15593:x1869759501168640:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 1856us (2286us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783142051.493022:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:0.0:1783142051.501869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.501988:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501168896 00000100:00100000:3.0:1783142051.501997:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501168896 00000100:00100000:3.0:1783142051.502055:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783142051.502065:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f535053a-080f-4e4a-b39d-b0db6255876b+9:15593:x1869759501168896:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783142051.502514:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f535053a-080f-4e4a-b39d-b0db6255876b+10:15593:x1869759501168896:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 449us (652us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783142051.502531:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783142051.508471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.508569:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169152 00000100:00100000:2.0:1783142051.508579:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169152 00000100:00100000:2.0:1783142051.508642:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783142051.508651:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+10:15593:x1869759501169152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783142051.508678:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.508697:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb0c expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508764:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508779:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508791:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508802:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508810:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.508817:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.508939:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783142051.509041:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509050:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509057:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509064:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.509068:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509076:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509089:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.509093:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.509097:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509103:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a380855e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509118:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509124:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509130:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509147:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.509151:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509157:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509165:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:2.0:1783142051.509168:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.509170:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509176:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a3808565 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509516:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808557 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb0c expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509660:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.509663:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783142051.509668:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a3808557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb0c expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.509678:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1200, rc 0) 00000100:00100000:2.0:1783142051.509732:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f535053a-080f-4e4a-b39d-b0db6255876b+11:15593:x1869759501169152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1081us (1270us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783142051.509740:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783142051.513784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.513865:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169280 00000100:00100000:2.0:1783142051.513884:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169280 00000100:00100000:2.0:1783142051.514213:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:2.0:1783142051.514232:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f535053a-080f-4e4a-b39d-b0db6255876b+11:15593:x1869759501169280:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783142051.514265:0:18453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.514324:0:18453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a3808573 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb13 expref: -99 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514455:0:18453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514469:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514488:0:18453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.514750:0:18453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783142051.514755:0:18453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142051.514785:0:18453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514822:0:18453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a3808573 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 13 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514847:0:18453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 12 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.514856:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:2.0:1783142051.514859:0:18453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783142051.514862:0:18453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142051.514982:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f535053a-080f-4e4a-b39d-b0db6255876b+12:15593:x1869759501169280:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 758us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142051.514991:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1783142051.521573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.521750:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169408 00000100:00100000:1.0:1783142051.521774:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169408 00000100:00100000:1.0:1783142051.521905:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:1.0:1783142051.521917:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f535053a-080f-4e4a-b39d-b0db6255876b+12:15593:x1869759501169408:12345-192.168.203.39@tcp:37:lfs.0 00010000:00010000:2.0:1783142051.524516:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783142051.531737:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f535053a-080f-4e4a-b39d-b0db6255876b+12:15593:x1869759501169408:12345-192.168.203.39@tcp:37:lfs.0 Request processed in 9812us (10164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142051.531753:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:0.0:1783142051.534976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.539712:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169664 00000100:00100000:2.0:1783142051.539724:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169664 00000100:00100000:2.0:1783142051.539787:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783142051.539796:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f535053a-080f-4e4a-b39d-b0db6255876b+12:15593:x1869759501169664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783142051.540615:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f535053a-080f-4e4a-b39d-b0db6255876b+13:15593:x1869759501169664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 815us (5652us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783142051.540625:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783142051.595405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.595543:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169792 00000100:00100000:3.0:1783142051.595553:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169792 00000100:00100000:3.0:1783142051.595615:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783142051.595625:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+11:15599:x1869759501169792:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783142051.595646:0:19933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142051.595668:0:19933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a3808581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb1a expref: -99 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595726:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595739:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595749:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595758:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595783:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595789:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595871:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0a00/0xb31399d6a3808596 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595880:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0a00/0xb31399d6a3808596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595898:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0a00/0xb31399d6a3808596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783142051.595931:0:19933:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783142051.595935:0:19933:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783142051.595979:0:19933:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0a00/0xb31399d6a3808596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595991:0:19933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.595998:0:19933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596005:0:19933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596011:0:19933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142051.596015:0:19933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596032:0:19933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596046:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:3.0:1783142051.596050:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783142051.596055:0:19933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596061:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596075:0:19933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596082:0:19933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596088:0:19933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596093:0:19933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142051.596096:0:19933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596102:0:19933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596109:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:3.0:1783142051.596111:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783142051.596114:0:19933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596128:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a380858f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596156:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a3808581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb1a expref: 13 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596169:0:19933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0a00/0xb31399d6a3808596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb1a expref: 12 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.596175:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:3.0:1783142051.596177:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783142051.596179:0:19933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e0a00, rc 0) 00000100:00100000:3.0:1783142051.596247:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+12:15599:x1869759501169792:12345-192.168.203.39@tcp:101:bash.0 Request processed in 623us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.596255:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:0.0:1783142051.600043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.600120:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501169920 00000100:00100000:3.0:1783142051.600130:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501169920 00000100:00100000:3.0:1783142051.600186:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783142051.600196:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:15599:x1869759501169920:12345-192.168.203.39@tcp:900:bash.0 00000100:00100000:3.0:1783142051.600311:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:15599:x1869759501169920:12345-192.168.203.39@tcp:900:bash.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.600320:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783142051.603247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.603436:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501170176 00000100:00100000:2.0:1783142051.603448:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501170176 00000100:00100000:2.0:1783142051.603514:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1783142051.603525:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+12:15599:x1869759501170176:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783142051.603547:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.603567:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380859d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb21 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.603671:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.603686:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 12 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.603694:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.603746:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 12 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.603758:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 12 pid: 18453 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142051.603770:0:17144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162496:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783142051.603858:0:17144:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c488dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1783142051.606810:0:17144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162496:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142051.606839:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142051.608060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142051.608654:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501170304 00000100:00100000:0.0:1783142051.608663:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501170304 00010000:00010000:0.0:1783142051.608704:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 13 pid: 18453 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142051.608747:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783142051.608771:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f535053a-080f-4e4a-b39d-b0db6255876b+13:2402:x1869759501170304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783142051.608786:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783142051.608793:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 13 pid: 18453 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608807:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 13 pid: 18453 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608828:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a380857a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb13 expref: 13 pid: 18453 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608847:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:0.0:1783142051.608852:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608861:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608869:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142051.608899:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783142051.608967:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f535053a-080f-4e4a-b39d-b0db6255876b+12:2402:x1869759501170304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142051.608975:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00010000:00010000:2.0:1783142051.609665:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.609675:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.609699:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.609709:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.609718:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610156:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610176:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610183:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.610194:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783142051.610481:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610489:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610496:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610502:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142051.610506:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610513:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610524:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:2.0:1783142051.610528:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142051.610531:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610538:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783142051.610549:0:17144:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd240ffe reply state 000000002e8da836 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610569:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610575:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f9b42686100) 00010000:00010000:2.0:1783142051.610578:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783142051.610580:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783142051.610619:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380859d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610633:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.610639:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142051.610642:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783142051.610644:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1c00, rc 0) 00000100:00100000:2.0:1783142051.610740:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+15:15599:x1869759501170176:12345-192.168.203.39@tcp:101:bash.0 Request processed in 7217us (7503us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783142051.610749:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:3.0:1783142051.636791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.636972:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501170432 00000100:00100000:2.0:1783142051.636982:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501170432 00000100:00100000:2.0:1783142051.637040:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:2.0:1783142051.637050:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+15:15599:x1869759501170432:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783142051.637073:0:18453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.637091:0:18453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb28 expref: -99 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637160:0:18453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637187:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637198:0:18453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.637257:0:18453:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783142051.637262:0:18453:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142051.637325:0:18453:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637336:0:18453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637359:0:18453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 17 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637377:0:18453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 16 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.637387:0:18453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142051.637389:0:18453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783142051.637392:0:18453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b1200, rc 0) 00000100:00100000:2.0:1783142051.637580:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+16:15599:x1869759501170432:12345-192.168.203.39@tcp:101:bash.0 Request processed in 531us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142051.637588:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:0.0:1783142051.645778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.647007:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501170688 00000100:00100000:1.0:1783142051.647021:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501170688 00000100:00100000:1.0:1783142051.647090:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783142051.647100:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+16:15599:x1869759501170688:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:1.0:1783142051.647577:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6cccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+17:15599:x1869759501170688:12345-192.168.203.39@tcp:35:bash.0 Request processed in 477us (1807us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783142051.647586:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1783142051.756096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.756196:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501170944 00000100:00100000:1.0:1783142051.756205:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501170944 00000100:00100000:1.0:1783142051.756269:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783142051.756321:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+17:15609:x1869759501170944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783142051.756348:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142051.756367:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38085ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb2f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.756691:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783142051.756794:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38085ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb2f expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.756828:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f9b42686800) 00010000:00010000:2.0:1783142051.756831:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783142051.756836:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd4200/0xb31399d6a38085ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb2f expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.756851:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd4200, rc 0) 00000100:00100000:2.0:1783142051.756928:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+18:15609:x1869759501170944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 609us (842us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783142051.756936:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:3.0:1783142051.760715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.760904:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501171200 00000100:00100000:1.0:1783142051.760915:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501171200 00000100:00100000:1.0:1783142051.760978:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783142051.760988:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+18:15609:x1869759501171200:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783142051.761204:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15609:x1869759501171200:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 216us (496us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783142051.761224:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783142051.802992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142051.803145:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501171456 00000100:00100000:2.0:1783142051.803156:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501171456 00000100:00100000:2.0:1783142051.803229:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:2.0:1783142051.803239:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15612:x1869759501171456:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783142051.803263:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142051.803319:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb36 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.803587:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.803603:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.803614:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142051.803628:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783142051.803748:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb36 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.803766:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb36 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142051.803775:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142051.803778:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783142051.803781:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142051.803842:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6ccc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15612:x1869759501171456:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 604us (861us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783142051.803850:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:0.0:1783142051.807035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.807139:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501171584 00000100:00100000:3.0:1783142051.807155:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501171584 00000100:00100000:3.0:1783142051.807221:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783142051.807231:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15612:x1869759501171584:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783142051.807328:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807346:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807356:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807395:0:19933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807402:0:19933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807419:0:19933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807425:0:19933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142051.807429:0:19933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807436:0:19933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807447:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142051.807450:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783142051.807454:0:19933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.807471:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38085f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142051.807533:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15612:x1869759501171584:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 302us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.807540:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783142051.812048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142051.812156:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501171840 00000100:00100000:1.0:1783142051.812166:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501171840 00000100:00100000:1.0:1783142051.812231:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783142051.812241:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15612:x1869759501171840:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783142051.812510:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+22:15612:x1869759501171840:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 269us (472us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783142051.812519:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783142051.817743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142051.817819:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501171968 00000100:00100000:3.0:1783142051.817830:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501171968 00000100:00100000:3.0:1783142051.817910:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783142051.817920:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+22:2403:x1869759501171968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142051.817935:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142051.817970:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb36 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142051.817988:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142051.817992:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142051.818103:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:2403:x1869759501171968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 183us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142051.818111:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000040:00080000:1.0:1783142051.844917:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783142052.100682:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783142052.100709:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521162624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783142052.100783:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142052.100880:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521162624 00000100:00100000:2.0:1783142052.100887:0:17961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521162624 00000100:00100000:2.0:1783142052.100942:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783142052.100960:0:17961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521162624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783142052.100997:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783142052.101047:0:17961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521162624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.101054:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783142052.101150:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521162624:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1783142052.101907:0:17895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783142052.106025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.106080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.106109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.106150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.106179:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172224 00000100:00100000:3.0:1783142052.106188:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172224 00000100:00100000:3.0:1783142052.106255:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172352 00000100:00100000:3.0:1783142052.106258:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172352 00000100:00100000:3.0:1783142052.106375:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172608 00000100:00100000:3.0:1783142052.106379:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172608 00000100:00100000:3.0:1783142052.106401:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783142052.106470:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c43748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2403:x1869759501172224:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783142052.106540:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c43748c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2403:x1869759501172224:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.106548:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783142052.106664:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783142052.106671:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501172352:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783142052.106693:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501172352:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.106698:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783142052.106708:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783142052.106713:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501172608:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783142052.106734:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f535053a-080f-4e4a-b39d-b0db6255876b+5:2402:x1869759501172608:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.106738:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00080000:3.0:1783142052.106757:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783142052.106760:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783142052.109528:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172096 00000100:00100000:2.0:1783142052.109542:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172096 00000100:00100000:2.0:1783142052.109607:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:2.0:1783142052.109617:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:2402:x1869759501172096:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783142052.109700:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a64d9db-5acd-4599-9ece-63fc5c8d7b53+13:2402:x1869759501172096:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.109708:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:3.0:1783142052.114580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.114774:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172480 00000100:00100000:0.0:1783142052.114784:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172480 00000100:00100000:0.0:1783142052.114861:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783142052.114871:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f535053a-080f-4e4a-b39d-b0db6255876b+5:2403:x1869759501172480:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783142052.114966:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f535053a-080f-4e4a-b39d-b0db6255876b+5:2403:x1869759501172480:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 96us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.114975:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00080000:3.0:1783142052.115904:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783142052.137794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.137908:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501172864 00000100:00100000:2.0:1783142052.137919:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501172864 00000100:00100000:2.0:1783142052.137992:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783142052.138003:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15643:x1869759501172864:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1783142052.138029:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142052.138049:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb3d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.138154:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.138168:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.138181:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142052.138191:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783142052.138334:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a38085f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb3d expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.138352:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb3d expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.138360:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142052.138363:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783142052.138366:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142052.138434:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:15643:x1869759501172864:12345-192.168.203.39@tcp:101:cat.0 Request processed in 433us (649us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1783142052.138458:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783142052.142576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.142654:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173120 00000100:00100000:1.0:1783142052.142663:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173120 00000100:00100000:1.0:1783142052.142711:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783142052.142721:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:15643:x1869759501173120:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:1.0:1783142052.143003:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+24:15643:x1869759501173120:12345-192.168.203.39@tcp:35:cat.0 Request processed in 283us (434us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783142052.143011:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:0.0:1783142052.148635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.148702:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173248 00000100:00100000:3.0:1783142052.148711:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173248 00000100:00100000:3.0:1783142052.148770:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:3.0:1783142052.148779:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+24:2402:x1869759501173248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142052.148806:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142052.148827:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a38085ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb3d expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.148843:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142052.148847:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142052.148941:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:2402:x1869759501173248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 162us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.148948:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783142052.200738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.200836:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173504 00000100:00100000:2.0:1783142052.200845:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173504 00000100:00100000:2.0:1783142052.200906:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783142052.200914:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:15649:x1869759501173504:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783142052.200937:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142052.200968:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380860d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb44 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201064:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201077:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201086:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 24 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201094:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201123:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 24 pid: 18453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201134:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 24 pid: 18453 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142052.201165:0:17144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162752:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142052.201323:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.201331:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142052.201340:0:17144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f90c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162880:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783142052.201365:0:17144:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1480 going to sleep for 11 seconds 00000100:00100000:2.0:1783142052.205122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.205235:0:17144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783142052.205247:0:17144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f90c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17144:1869759521162880:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783142052.205319:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142052.205421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.205813:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173632 00000100:00100000:3.0:1783142052.205820:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173632 00010000:00010000:3.0:1783142052.205857:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 25 pid: 18453 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142052.206207:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173760 00000100:00100000:3.0:1783142052.206211:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173760 00010000:00010000:3.0:1783142052.206228:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 26 pid: 17144 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142052.206267:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783142052.206295:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+26:2402:x1869759501173632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783142052.206320:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783142052.206328:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 26 pid: 18453 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206341:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 26 pid: 18453 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206360:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1200/0xb31399d6a38085c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb28 expref: 26 pid: 18453 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206393:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:0.0:1783142052.206409:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206418:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206424:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783142052.206478:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+25:2402:x1869759501173632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 185us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.206486:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783142052.206502:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:0.0:1783142052.206508:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c77755c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+24:2402:x1869759501173760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783142052.206516:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783142052.206520:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206530:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206542:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1c00/0xb31399d6a38085b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb21 expref: 24 pid: 17144 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206551:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:0.0:1783142052.206555:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206571:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206579:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.206601:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783142052.206620:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c77755c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:2402:x1869759501173760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 111us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.206626:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00010000:00010000:2.0:1783142052.206998:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.207007:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142052.207025:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783142052.207163:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1600/0xb31399d6a380860d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb44 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.207178:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b0e00/0xb31399d6a3808614 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb44 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.207184:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142052.207186:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783142052.207194:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c6f7b0e00, rc 0) 00000100:00100000:2.0:1783142052.207226:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:15649:x1869759501173504:12345-192.168.203.39@tcp:101:dd.0 Request processed in 6313us (6497us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783142052.207233:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783142052.210789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.210863:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501173888 00000100:00100000:1.0:1783142052.210872:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501173888 00000100:00100000:1.0:1783142052.211019:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783142052.211042:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+23:15649:x1869759501173888:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1783142052.211066:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783142052.211086:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5000/0xb31399d6a3808622 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb4b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211117:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211130:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211141:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211242:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5000/0xb31399d6a3808622 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 25 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211259:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.211268:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:1.0:1783142052.211450:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783142052.211454:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b41bd5a00, rc 0) 00000100:00100000:0.0:1783142052.211550:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+24:15649:x1869759501173888:12345-192.168.203.39@tcp:101:dd.0 Request processed in 508us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.211558:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783142052.213395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.214508:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174144 00000100:00100000:2.0:1783142052.214520:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174144 00000100:00100000:2.0:1783142052.214576:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1783142052.214586:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+24:15649:x1869759501174144:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1783142052.214805:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.214821:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.214833:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783142052.214877:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783142052.214916:0:17142:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f04d6b5 reply state 0000000076ca98b4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.214929:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.214938:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142052.214941:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783142052.214944:0:17142:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783142052.215053:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174144:12345-192.168.203.39@tcp:36:dd.0 Request processed in 467us (1664us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783142052.215061:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000020:00080000:2.0:1783142052.215080:0:17142:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783142052.216836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.216914:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174272 00000100:00100000:3.0:1783142052.216923:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174272 00000100:00100000:3.0:1783142052.216980:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:3.0:1783142052.216989:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174272:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1783142052.217012:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142052.217028:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a3808637 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb52 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.217092:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a3808637 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb52 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.217105:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a3808637 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb52 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.217122:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142052.217125:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783142052.217128:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e0200, rc 0) 00000100:00100000:3.0:1783142052.217176:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15649:x1869759501174272:12345-192.168.203.39@tcp:101:dd.0 Request processed in 187us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.217183:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1783142052.227298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.227380:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174528 00000100:00100000:1.0:1783142052.227389:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174528 00000100:00100000:1.0:1783142052.227458:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1783142052.227468:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15649:x1869759501174528:12345-192.168.203.39@tcp:103:dd.0 00010000:00010000:1.0:1783142052.227483:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783142052.227516:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0200/0xb31399d6a3808637 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb52 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142052.227534:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:1.0:1783142052.227538:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783142052.227591:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174528:12345-192.168.203.39@tcp:103:dd.0 Request processed in 125us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142052.227599:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783142052.229634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.229722:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174656 00000100:00100000:2.0:1783142052.229732:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174656 00000100:00100000:2.0:1783142052.229786:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783142052.229795:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174656:12345-192.168.203.39@tcp:58:dd.0 00010000:00010000:2.0:1783142052.229905:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.229923:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.229935:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783142052.231053:0:19933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783142052.231084:0:19933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783142052.231241:0:19933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783142052.231364:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174656:12345-192.168.203.39@tcp:58:dd.0 Request processed in 1566us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.231375:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783142052.236586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.236681:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174784 00000100:00100000:0.0:1783142052.236690:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174784 00000100:00100000:0.0:1783142052.236750:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1783142052.236759:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+27:15649:x1869759501174784:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1783142052.236779:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142052.236798:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb59 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236847:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236857:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236875:0:17142:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236914:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236927:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:0.0:1783142052.236930:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783142052.236934:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 28 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.236942:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2000, rc 0) 00000100:00100000:0.0:1783142052.237007:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15649:x1869759501174784:12345-192.168.203.39@tcp:101:dd.0 Request processed in 248us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.237014:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00010000:00010000:0.0:1783142052.550325:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142052.614151:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783142052.614172:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521163008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783142052.614237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142052.614298:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163008 00000100:00100000:3.0:1783142052.614305:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163008 00000100:00080000:2.0:1783142052.614337:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783142052.614356:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783142052.614366:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521163008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783142052.614404:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783142052.614454:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521163008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142052.614461:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783142052.615110:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521163136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783142052.615149:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142052.615211:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521163008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783142052.615596:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521163520:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.615637:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142052.615662:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521163648:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.615667:0:3652:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521164032:0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.615707:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142052.615714:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163520 00000100:00100000:0.0:1783142052.615719:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163520 00000100:00100000:1.0:1783142052.615737:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521164160:0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.615763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783142052.615769:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783142052.615778:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521163520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.615794:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142052.615860:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521163264:0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.615911:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1869759521163520:0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.615934:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163648 00000100:00100000:1.0:1783142052.615938:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163648 00000100:00100000:1.0:1783142052.615972:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521164160 00000100:00100000:1.0:1783142052.615975:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521164160 00000100:00100000:1.0:1783142052.615995:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521164032 00000100:00100000:1.0:1783142052.615998:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521164032 00000100:00100000:1.0:1783142052.616024:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783142052.616031:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521163648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783142052.616095:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521163392:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.618836:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1869759521163520:12345-0@lo:400:kworker.0 Request processed in 3049us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.618863:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783142052.618865:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783142052.618913:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783142052.618920:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783142052.618932:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521163776:0@lo:400:kworker.0 00000100:00080000:0.0:1783142052.618937:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783142052.618966:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783142052.618979:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521164160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.619043:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1869759521164160:12345-0@lo:400:kworker.0 Request processed in 68us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.619049:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783142052.619092:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c4b3d5180 x1869759521164160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783142052.619106:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1869759521164160:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.619130:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783142052.619137:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521164032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.619174:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1869759521164032:12345-0@lo:400:kworker.0 Request processed in 37us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.619179:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783142052.619212:0:3652:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1869759521164032:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.619247:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163264 00000100:00100000:0.0:1783142052.619252:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163264 00000100:00100000:0.0:1783142052.619307:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783142052.619315:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3654:x1869759521163264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142052.619411:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521164288:0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619440:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142052.619476:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163776 00000100:00100000:2.0:1783142052.619481:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163776 00000100:00100000:2.0:1783142052.619506:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783142052.619513:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521163776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619551:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521163776:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.619557:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783142052.619583:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521163776:0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619600:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521164288 00000100:00100000:2.0:1783142052.619603:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521164288 00000100:00100000:2.0:1783142052.619630:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783142052.619636:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521164288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619671:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1869759521164288:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.619678:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1783142052.619692:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783142052.619707:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1869759521164288:0@lo:400:kworker.0 00000100:00100000:2.0:1783142052.619741:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163136 00000100:00100000:2.0:1783142052.619745:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163136 00000100:00100000:2.0:1783142052.619774:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783142052.619780:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521163136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783142052.619803:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783142052.619839:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1869759521163136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (4689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.619846:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1783142052.619859:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783142052.619903:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c762ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1869759521163136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783142052.619936:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c7ca02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0f07033-43f3-43e4-aeca-29a1a105dcc2+24:3654:x1869759521163264:12345-0@lo:400:kworker.0 Request processed in 620us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.619944:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783142052.621494:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0f07033-43f3-43e4-aeca-29a1a105dcc2:3654:1869759521163264:0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.621679:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1869759521163648:12345-0@lo:400:kworker.0 Request processed in 5646us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142052.621690:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783142052.621782:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c76309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1869759521163648:0@lo:400:kworker.0 00000100:00100000:3.0:1783142052.622132:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142052.622458:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521163904:0@lo:400:kworker.0 00000100:00100000:3.0:1783142052.622491:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142052.622518:0:3655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521164416:0@lo:400:kworker.0 00000100:00100000:3.0:1783142052.622545:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783142052.622659:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163392 00000100:00100000:1.0:1783142052.622667:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163392 00000100:00100000:1.0:1783142052.622724:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783142052.622731:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521163392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783142052.622783:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1869759521163392:12345-0@lo:400:kworker.0 Request processed in 53us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142052.622790:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783142052.622888:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c7630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1869759521163392:0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.622935:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521163904 00000100:00100000:0.0:1783142052.622960:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521163904 00000100:00100000:0.0:1783142052.623026:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521164416 00000100:00100000:0.0:1783142052.623029:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521164416 00000100:00100000:0.0:1783142052.623078:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783142052.623084:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521163904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.623122:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1869759521163904:12345-0@lo:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.623128:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783142052.623140:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783142052.623146:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783142052.623182:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1869759521164416:12345-0@lo:400:kworker.0 Request processed in 36us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.623188:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783142052.623340:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783142052.623696:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1869759521163904:0@lo:400:kworker.0 00010000:00080000:2.0:1783142052.623710:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f9c4b3d6d80 x1869759521164416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783142068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783142052.623720:0:3655:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1869759521164416:0@lo:400:kworker.0 00000040:00080000:1.0:1783142052.868661:0:17178:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783142052.868671:0:17178:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783142052.868697:0:17178:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783142052.868706:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783142052.868827:0:17178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17178:1869759521164544:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783142052.868922:0:17178:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783142052.874190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.874302:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501174912 00000100:00100000:1.0:1783142052.874311:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501174912 00000100:00100000:1.0:1783142052.874381:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:1.0:1783142052.874391:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501174912:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783142052.874422:0:18453:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783142052.874553:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501174912:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142052.874563:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:3.0:1783142052.874593:0:17178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17178:1869759521164544:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783142052.884169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.885085:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501175040 00000100:00100000:2.0:1783142052.885100:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501175040 00000100:00100000:2.0:1783142052.885185:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783142052.885195:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15650:x1869759501175040:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783142052.885265:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885323:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885336:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885423:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885432:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885440:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885461:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885470:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885476:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142052.885521:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783142052.885525:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142052.885536:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885546:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885552:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885559:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885577:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.885581:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885589:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885600:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9b42686200) 00010000:00010000:2.0:1783142052.885603:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.885607:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885613:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380864c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885628:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885633:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885640:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885645:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43550000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.885648:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885653:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885668:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f9b42686600) 00010000:00010000:2.0:1783142052.885670:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.885672:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885678:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a3808653 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885691:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885697:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885703:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885708:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.885711:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885716:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885722:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142052.885724:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.885727:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.885732:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a380865a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142052.886145:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15650:x1869759501175040:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 949us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.886155:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783142052.890259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142052.890688:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501175296 00000100:00100000:3.0:1783142052.890697:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501175296 00000100:00100000:3.0:1783142052.890746:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:3.0:1783142052.890754:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+28:15650:x1869759501175296:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783142052.890773:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783142052.891002:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a3808661 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb60 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891101:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891117:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891129:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783142052.891245:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783142052.891569:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891594:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891601:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891607:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142052.891611:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891619:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891631:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142052.891633:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783142052.891637:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891643:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a3808668 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891683:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a3808661 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb60 expref: 30 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891693:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f9b42686200) 00010000:00010000:3.0:1783142052.891695:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783142052.891699:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a3808661 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb60 expref: 30 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142052.891708:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9b423e0000, rc 0) 00000100:00100000:3.0:1783142052.891915:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501175296:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1665us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783142052.891924:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:1.0:1783142052.899183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.899250:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501175424 00000100:00100000:0.0:1783142052.899265:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501175424 00000100:00100000:0.0:1783142052.899617:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783142052.899628:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501175424:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783142052.899663:0:19933:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783142052.899789:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501175424:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 163us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.899797:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783142052.903553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.903624:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501175680 00000100:00100000:2.0:1783142052.903638:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501175680 00000100:00100000:2.0:1783142052.903694:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:2.0:1783142052.903705:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+29:15650:x1869759501175680:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783142052.903725:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142052.903744:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a3808676 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb67 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783142052.904169:0:17143:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1783142052.904176:0:17143:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1783142052.904194:0:17143:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1783142052.904722:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a380867d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.904751:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a380867d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.904763:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a380867d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.904829:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a3808676 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb67 expref: 32 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.904857:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a380867d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb67 expref: 31 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.904873:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9b42686600) 00010000:00010000:2.0:1783142052.904876:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783142052.904880:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c43550000, rc 0) 00000100:00100000:2.0:1783142052.904957:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+31:15650:x1869759501175680:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1242us (1459us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783142052.904966:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783142052.908975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.909129:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501175936 00000100:00100000:2.0:1783142052.909150:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501175936 00000100:00100000:2.0:1783142052.909215:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:2.0:1783142052.909225:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+31:15650:x1869759501175936:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783142052.909319:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783142052.909347:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550000/0xb31399d6a380867d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb67 expref: 31 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909364:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9b42686600) 00010000:00010000:2.0:1783142052.909374:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783142052.909393:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909418:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909427:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909500:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909526:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909533:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909580:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909587:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909593:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909599:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.909603:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909610:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909617:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:2.0:1783142052.909620:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.909623:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909628:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551e00/0xb31399d6a380868b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909638:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909650:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909655:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909660:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.909662:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909667:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909674:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9ec8380c (ffff9f9b42686a00) 00010000:00010000:2.0:1783142052.909676:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.909680:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.909685:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a3808692 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9ec8380c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142052.909766:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+30:15650:x1869759501175936:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 542us (815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783142052.909773:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1783142052.913751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.913859:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501176064 00000100:00100000:0.0:1783142052.913868:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501176064 00000100:00100000:0.0:1783142052.914050:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:0.0:1783142052.914060:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+30:15650:x1869759501176064:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783142052.914080:0:19933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142052.914102:0:19933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3808699 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb6e expref: -99 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.914227:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38086a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.914239:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38086a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.914250:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38086a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.915158:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3a00/0xb31399d6a3808699 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb6e expref: 32 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.915182:0:19933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3000/0xb31399d6a38086a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb6e expref: 31 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.915191:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:0.0:1783142052.915193:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783142052.915197:0:19933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3000, rc 0) 00000100:00100000:0.0:1783142052.915528:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+31:15650:x1869759501176064:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1468us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.915536:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1783142052.919100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.919178:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501176320 00000100:00100000:2.0:1783142052.919188:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501176320 00000100:00100000:2.0:1783142052.919317:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:2.0:1783142052.919327:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+31:15650:x1869759501176320:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783142052.919408:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.919440:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.919451:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783142052.919615:0:17143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1783142052.919626:0:17143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563986353445ns, next at 564986350635ns, rc = 0 00000004:00010000:2.0:1783142052.919678:0:17143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9b476bc reply state 00000000a569f846 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.919693:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.919700:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:2.0:1783142052.919704:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783142052.919708:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783142052.919798:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+33:15650:x1869759501176320:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 472us (706us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783142052.919806:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1783142052.922939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.923250:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501176448 00000100:00100000:0.0:1783142052.923261:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501176448 00000100:00100000:0.0:1783142052.923355:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:0.0:1783142052.923365:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+33:15650:x1869759501176448:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783142052.923388:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142052.923419:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb75 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.923489:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.923502:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.923520:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:0.0:1783142052.923523:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783142052.923527:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2400, rc 0) 00000100:00100000:0.0:1783142052.923594:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+34:15650:x1869759501176448:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 230us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.923601:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:1.0:1783142052.927167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.927321:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501176576 00000100:00100000:0.0:1783142052.927331:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501176576 00000100:00100000:0.0:1783142052.927384:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:0.0:1783142052.927399:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2402:x1869759501176576:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783142052.927624:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2402:x1869759501176576:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 232us (465us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783142052.927632:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1783142052.936024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.936561:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501176832 00000100:00100000:1.0:1783142052.936572:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501176832 00000100:00100000:1.0:1783142052.936630:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783142052.936655:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+34:15650:x1869759501176832:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783142052.936882:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+35:15650:x1869759501176832:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 228us (868us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1783142052.936891:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:3.0:1783142052.940722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.941258:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177088 00000100:00100000:0.0:1783142052.941268:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177088 00000100:00100000:0.0:1783142052.941451:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:0.0:1783142052.941462:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+35:15650:x1869759501177088:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783142052.941574:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+35:15650:x1869759501177088:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 113us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.941593:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:3.0:1783142052.947537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783142052.947636:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177216 00000100:00100000:2.0:1783142052.947645:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177216 00000100:00100000:2.0:1783142052.947705:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:2.0:1783142052.947715:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+35:15650:x1869759501177216:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783142052.947736:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783142052.947755:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a38086b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb7c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947841:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947856:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947868:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783142052.947911:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783142052.947930:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947967:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551200/0xb31399d6a38086b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb7c expref: 37 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947985:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb7c expref: 36 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.947994:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:2.0:1783142052.947996:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783142052.948000:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c43551a00, rc 0) 00000100:00100000:2.0:1783142052.948059:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+36:15650:x1869759501177216:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 344us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142052.948066:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:2.0:1783142052.953097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.953248:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177344 00000100:00100000:0.0:1783142052.953259:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177344 00000100:00100000:0.0:1783142052.953347:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783142052.953357:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+6:2403:x1869759501177344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783142052.953375:0:18649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142052.953395:0:18649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb83 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783142052.953429:0:18649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4896a5, blocks: 0x0 00010000:00010000:0.0:1783142052.953448:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1783142052.953453:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142052.953462:0:18649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 7 pid: 18649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.953482:0:18649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 7 pid: 18649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.953494:0:18649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a3a00, rc 0) 00000100:00100000:0.0:1783142052.953563:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2403:x1869759501177344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 208us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.953571:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:3.0:1783142052.965796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142052.966030:0:18453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177600 00000100:00100000:1.0:1783142052.966050:0:18453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177600 00000100:00100000:1.0:1783142052.966110:0:18453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1783142052.966120:0:18453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+36:15650:x1869759501177600:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783142052.966231:0:18453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+36:15650:x1869759501177600:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 111us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783142052.966239:0:18453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1783142052.972146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.972641:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177728 00000100:00100000:0.0:1783142052.972653:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177728 00000100:00100000:0.0:1783142052.972716:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:0.0:1783142052.972726:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+36:15650:x1869759501177728:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783142052.978639:0:17122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1783142052.978657:0:17122:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1783142052.978711:0:17122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783142052.978877:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783142052.978896:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521164672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783142052.978968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783142052.979445:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979472:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979479:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979485:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.979489:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979496:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979511:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f9c7b5c2a00) 00010000:00010000:2.0:1783142052.979514:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.979519:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979524:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5c00/0xb31399d6a38084fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979547:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979553:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979558:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979563:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd5800 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.979571:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979577:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979585:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:2.0:1783142052.979587:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.979590:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979595:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5800/0xb31399d6a3808503 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18453 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979608:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979615:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979621:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979625:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c6f7b1000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.979628:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979633:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979639:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f9b42686100) 00010000:00010000:2.0:1783142052.979641:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.979650:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979655:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c6f7b1000/0xb31399d6a38085ab lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979669:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979675:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979680:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979685:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43550c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.979688:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979694:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979701:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142052.979702:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783142052.979705:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979710:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a3808630 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979718:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979732:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979737:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979741:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551400 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142052.979744:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979748:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979754:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:2.0:1783142052.979756:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783142052.979759:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142052.979763:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551400/0xb31399d6a38086a7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.979969:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.979977:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.979982:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.979986:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1200 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:0.0:1783142052.979989:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.979994:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.980002:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f9c7b5c2100) 00010000:00010000:0.0:1783142052.980004:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783142052.980006:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142052.980012:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1200/0xb31399d6a3808550 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142052.980039:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521164672 00000100:00100000:0.0:1783142052.980057:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521164672 00000100:00100000:0.0:1783142052.980106:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783142052.980115:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1869759521164672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783142052.980521:0:18650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783142052.980525:0:18650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783142052.980535:0:18650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783142052.980537:0:18650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783142053 -> 1783142053 00002000:00010000:0.0:1783142052.980540:0:18650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783142052.980611:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b442c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1869759521164672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 495us (1642us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783142052.980619:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783142052.980730:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b43554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+15:15650:x1869759501177728:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 8004us (8599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.980738:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000004:00080000:3.0:1783142052.980880:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f9b442c8000/2, rc 0, transno 8589934596 00000100:00100000:3.0:1783142052.980887:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9b442c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521164672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783142052.988728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142052.988797:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501177856 00000100:00100000:0.0:1783142052.988808:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501177856 00000100:00100000:0.0:1783142052.988856:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783142052.988867:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2402:x1869759501177856:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783142052.988980:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2402:x1869759501177856:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142052.988988:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:2.0:1783142053.008911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142053.009577:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178112 00000100:00100000:0.0:1783142053.009588:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178112 00000100:00100000:0.0:1783142053.009669:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:0.0:1783142053.009680:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+15:15650:x1869759501178112:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783142053.009736:0:17143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783142053.009764:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551a00/0xb31399d6a38086bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb7c expref: 15 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.009785:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:0.0:1783142053.009790:0:17143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783142053.009831:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38086ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.009846:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38086ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.009855:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38086ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783142053.009989:0:17143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d548fee4 reply state 0000000097f15166 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38086ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.010002:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3200/0xb31399d6a38086ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.010009:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:0.0:1783142053.010011:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783142053.010014:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783142053.010190:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+16:15650:x1869759501178112:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 511us (1289us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1783142053.010197:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00080000:1.0:1783142053.010264:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783142053.027822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142053.027926:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178240 00000100:00100000:1.0:1783142053.027935:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178240 00000100:00100000:1.0:1783142053.028003:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783142053.028012:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2403:x1869759501178240:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783142053.028167:0:18943:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783142053.028171:0:18943:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783142052 00002000:00010000:1.0:1783142053.028173:0:18943:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783142052 00002000:00010000:1.0:1783142053.028176:0:18943:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783142053 -> 1783142052 00002000:00010000:1.0:1783142053.028178:0:18943:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783142053.028238:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+8:2403:x1869759501178240:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 227us (426us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783142053.028259:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:3.0:1783142053.032983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142053.033195:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178368 00000100:00100000:0.0:1783142053.033205:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178368 00000100:00100000:0.0:1783142053.033263:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783142053.033317:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+8:2400:x1869759501178368:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783142053.033360:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033377:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142053.033381:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142053.033406:0:18649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033421:0:18649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033444:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033452:0:18649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033460:0:18649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033467:0:18649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142053.033471:0:18649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033479:0:18649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033491:0:18649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.033499:0:18649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057db54e7/0xb31399d6a38086d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142053.033584:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+8:2400:x1869759501178368:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 312us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142053.033592:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1783142053.036913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142053.037003:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178624 00000100:00100000:3.0:1783142053.037013:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178624 00000100:00100000:3.0:1783142053.037079:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:3.0:1783142053.037088:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+16:15650:x1869759501178624:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783142053.037166:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.037183:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.037194:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.037241:0:17142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.037254:0:17142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 16 pid: 17143 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142053.037453:0:17142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521164800:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783142053.037622:0:17142:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c4a970540 going to sleep for 11 seconds 00000100:00100000:2.0:1783142053.041433:0:17142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c6f80c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521164800:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783142053.041461:0:17142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142053.042568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142053.042723:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178752 00000100:00100000:3.0:1783142053.042732:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178752 00010000:00010000:3.0:1783142053.042771:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 17 pid: 17143 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142053.042813:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783142053.042822:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+17:2402:x1869759501178752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142053.042836:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142053.042843:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 17 pid: 17143 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042855:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 17 pid: 17143 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042878:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b41bd5a00/0xb31399d6a3808629 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb4b expref: 17 pid: 17143 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042892:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142053.042904:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042915:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042922:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042929:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.042965:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142053.043029:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+16:2402:x1869759501178752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 207us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142053.043046:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00010000:00010000:2.0:1783142053.044327:0:17142:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044342:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044565:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044580:0:17142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044588:0:17142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044624:0:17142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.044637:0:17142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 16 pid: 17144 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142053.044649:0:17142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521164928:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783142053.044738:0:17142:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1540 going to sleep for 11 seconds 00000100:00100000:3.0:1783142053.049018:0:17142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521164928:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783142053.049058:0:17142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142053.050002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142053.050193:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501178880 00000100:00100000:3.0:1783142053.050201:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501178880 00010000:00010000:3.0:1783142053.050238:0:17127:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 17 pid: 17144 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142053.050318:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783142053.050327:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+17:2403:x1869759501178880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142053.050343:0:17127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142053.050349:0:17127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 17 pid: 17144 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050376:0:17127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 17 pid: 17144 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050404:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb75 expref: 17 pid: 17144 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050420:0:17127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:3.0:1783142053.050425:0:17127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050434:0:17127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050442:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.050469:0:17127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783142053.050799:0:17142:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.050808:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783142053.050920:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1783142053.051051:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783142053.051097:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783142053.051170:0:17142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17142:1869759521165056:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783142053.051251:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:2403:x1869759501178880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 924us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142053.051260:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1783142053.053177:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142053.053324:0:17142:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783142053.053608:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521165056 00000100:00100000:0.0:1783142053.053616:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521165056 00000100:00100000:0.0:1783142053.053695:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783142053.053705:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17142:x1869759521165056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783142053.053804:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17142:x1869759521165056:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142053.053813:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783142053.053874:0:17142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17142:1869759521165056:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783142053.054081:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783142053.054149:0:17142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17142:1869759521165184:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783142053.054202:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142053.054929:0:17142:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783142053.055005:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521165184 00000100:00100000:1.0:1783142053.055012:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521165184 00000100:00100000:1.0:1783142053.055143:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783142053.055153:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17142:x1869759521165184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783142053.055316:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17142:x1869759521165184:12345-0@lo:1000:mdt00_000.0 Request processed in 165us (1113us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783142053.055324:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783142053.055513:0:17142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17142:1869759521165184:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783142053.055554:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055565:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055572:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055579:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43550c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142053.055584:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055592:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055608:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:2.0:1783142053.055611:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783142053.055615:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055638:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43550c00/0xb31399d6a38086df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055670:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055676:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055681:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055685:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c43551c00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:2.0:1783142053.055688:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055694:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055701:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:2.0:1783142053.055704:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783142053.055710:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055721:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055730:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.055794:0:17142:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2000/0xb31399d6a3808645 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb59 expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142053.055807:0:17142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521165312:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783142053.055873:0:17142:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c48ad1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783142053.060666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142053.060763:0:17142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44279880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17142:1869759521165312:192.168.203.39@tcp:105: 00010000:00010000:3.0:1783142053.060790:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060800:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c43551c00/0xb31399d6a380863e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060833:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060859:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060870:0:17142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060881:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060888:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060894:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060900:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e1e00 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142053.060904:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060911:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060922:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142053.060925:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783142053.060929:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060935:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e1e00/0xb31399d6a38086e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060955:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060971:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060977:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060982:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b423e0000 already unused, calling callback (ffffffffc19844f0) 00010000:00010000:3.0:1783142053.060985:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.060991:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.061000:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:3.0:1783142053.061003:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783142053.061006:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.061012:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9b423e0000/0xb31399d6a38086d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17142 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142053.061180:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c44278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15650:x1869759501178624:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 24092us (24274us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1783142053.061191:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000020:00080000:3.0:1783142053.061196:0:17142:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783142053.062088:0:17178:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783142053.062094:0:17178:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783142053.062126:0:17178:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783142053.062134:0:17178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783142053.063640:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179008 00000100:00100000:0.0:1783142053.063653:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179008 00000100:00100000:0.0:1783142053.064578:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783142053.064591:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b436b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15649:x1869759501179008:12345-192.168.203.39@tcp:49:dd.0 00000100:00100000:0.0:1783142053.064717:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b436b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15649:x1869759501179008:12345-192.168.203.39@tcp:49:dd.0 Request processed in 128us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142053.064724:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1783142053.067577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142053.067937:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179264 00000100:00100000:0.0:1783142053.067956:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179264 00000100:00100000:0.0:1783142053.068012:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783142053.068021:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+19:15650:x1869759501179264:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783142053.068313:0:17146:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783142053.068355:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1783142053.068390:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068620:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068632:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068639:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068646:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068652:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.068766:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783142053.068855:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4b3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15650:x1869759501179264:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 834us (1285us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783142053.068864:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000020:00080000:0.0:1783142053.068869:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783142053.069810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142053.071088:0:19933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179392 00000100:00100000:0.0:1783142053.071100:0:19933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179392 00000100:00100000:0.0:1783142053.071161:0:19933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1783142053.071171:0:19933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+21:15649:x1869759501179392:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1783142053.071189:0:19933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783142053.071207:0:19933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2600/0xb31399d6a38086f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd3d22d190116eb8a expref: -99 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071239:0:19933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071265:0:19933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071566:0:19933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071671:0:19933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2600/0xb31399d6a38086f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb8a expref: 23 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071690:0:19933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a2400/0xb31399d6a38086fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb8a expref: 22 pid: 19933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.071699:0:19933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f9b42686f00) 00010000:00010000:0.0:1783142053.071702:0:19933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783142053.071706:0:19933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f9c414a2400, rc 0) 00000100:00100000:0.0:1783142053.071771:0:19933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0551ecf9-9ef0-4599-b72d-437ccd3f3832+22:15649:x1869759501179392:12345-192.168.203.39@tcp:101:dd.0 Request processed in 601us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783142053.071779:0:19933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00010000:00010000:1.0:1783142053.079604:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783142053.079620:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.079632:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a3e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:1.0:1783142053.079636:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.079646:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.079665:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f9c7b5c1e00) 00010000:00010000:1.0:1783142053.079668:0:17131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783142053.079689:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.079695:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f9c414a3e00/0xb31399d6a38086ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.079723:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142053.079725:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783142053.079727:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783142053.125187:0:3653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521165440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783142053.125298:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783142053.126505:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521165440 00000100:00100000:2.0:1783142053.126516:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521165440 00000100:00100000:2.0:1783142053.126576:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783142053.126586:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1869759521165440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783142053.126617:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783142053.126683:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c6f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1869759521165440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783142053.126690:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783142053.126927:0:3653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c44278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1869759521165440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783142053.129902:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521165568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783142053.130052:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142053.130153:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521165568 00000100:00100000:3.0:1783142053.130161:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521165568 00000100:00100000:3.0:1783142053.130217:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783142053.130226:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521165568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783142053.130262:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783142053.135192:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1869759521165568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4956us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142053.135207:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783142053.136533:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1869759521165568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783142053.289857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783142053.289923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783142053.289959:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179648 00000100:00100000:1.0:1783142053.289968:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179648 00000100:00100000:1.0:1783142053.290029:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179520 00000100:00100000:1.0:1783142053.290033:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179520 00000100:00100000:1.0:1783142053.290054:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783142053.290064:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:2403:x1869759501179648:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1783142053.290075:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783142053.290082:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00010000:00010000:1.0:1783142053.290097:0:18653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.290118:0:18653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 9 pid: 18649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.290127:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142053.290131:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783142053.290136:0:18653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.290167:0:18653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 9 pid: 18649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783142053.290191:0:18653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 9 pid: 18649 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783142053.290205:0:18653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c4b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18653:1869759521165696:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783142053.290293:0:18653:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f9c66933d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783142053.290844:0:20281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783142053.290862:0:20281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+9:2403:x1869759501179520:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:0.0:1783142053.290882:0:20281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.290894:0:20281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142053.290903:0:20281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783142053.290907:0:20281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.290916:0:20281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142053.293875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783142053.294017:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759501179776 00000100:00100000:3.0:1783142053.294026:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759501179776 00010000:00010000:3.0:1783142053.294065:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 10 pid: 18649 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783142053.294112:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:3.0:1783142053.294122:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+10:2403:x1869759501179776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783142053.294136:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783142053.294157:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 10 pid: 18649 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294170:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 10 pid: 18649 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294195:0:17128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142053.294200:0:17128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142053.294206:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294228:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294237:0:17128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142053.294240:0:17128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783142053.294243:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294250:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783142053.294299:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783142053.294360:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0551ecf9-9ef0-4599-b72d-437ccd3f3832+10:2403:x1869759501179776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 239us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142053.294368:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00010000:00010000:0.0:1783142053.295578:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000982a41f6/0xb31399d6a38086c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xd3d22d190116eb83 expref: 9 pid: 18649 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142053.295607:0:18653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c4b3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18653:1869759521165696:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783142053.295692:0:18653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.295704:0:18653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.295711:0:18653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.296361:0:20281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.296373:0:20281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783142053.415675:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1783142053.415697:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1783142053.420217:0:20281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1783142053.420226:0:20281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1783142052 -> 1783142053 00002000:00010000:0.0:1783142053.420230:0:20281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783142052 -> 1783142053 00002000:00010000:0.0:1783142053.420232:0:20281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1783142053.420249:0:20281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420296:0:20281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420306:0:20281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420314:0:20281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9c414a2600 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:0.0:1783142053.420319:0:20281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420337:0:20281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420358:0:20281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783142053.420367:0:20281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d93a4299/0xb31399d6a3808709 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783142053.420466:0:20281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c762af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0551ecf9-9ef0-4599-b72d-437ccd3f3832+7:2403:x1869759501179520:12345-192.168.203.39@tcp:4:dd.0 Request processed in 129601us (130538us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783142053.420477:0:20281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000001:00080000:0.0:1783142053.467256:0:18644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1783142053.467719:0:18653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1783142053.467724:0:18653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1783142053.467741:0:18653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467754:0:18653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467762:0:18653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467769:0:18653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f9b41bd4e00 already unused, calling callback (ffffffffc0d7ace0) 00010000:00010000:2.0:1783142053.467774:0:18653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467783:0:18653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467804:0:18653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783142053.467812:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063095174/0xb31399d6a3808702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783142053.467999:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9b44157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0551ecf9-9ef0-4599-b72d-437ccd3f3832+5:2403:x1869759501179648:12345-192.168.203.39@tcp:4:dd.0 Request processed in 177932us (178156us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783142053.468025:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00010000:00010000:2.0:1783142053.572786:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783142054.602544:0:18673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783142055.015015:0:20318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783142055.628318:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783142056.202662:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783142056.202686:0:3654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f9c763bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521165824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783142056.202751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783142056.203410:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759521165824 00000100:00100000:3.0:1783142056.203419:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759521165824 00000100:00100000:3.0:1783142056.203484:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783142056.203495:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521165824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783142056.203526:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783142056.203575:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f9c4427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1869759521165824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783142056.203583:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783142056.203683:0:3654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f9c763bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1869759521165824:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783142056.204482:0:17138:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783142056.644544:0:17130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41054 lines, 41054 kept, 0 dropped, 0 bad.